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(54) METHOD FOR CONVERTING DIGITAL SIGNAL AND APPARATUS FOR CONVERTING 
DIGITAL SIGNAL 

(57) An inputted digital signal of a first format (DV 
video signal) is restored to a variable-length code by 
having its framing cancelled by a de-framing section 1 1 , 
then decoded by a variable-length decoding (VLD) sec- 
tion 12, inversely quantized by an inverse quantizing 
(IQ) section 13. and inversely weighted by an inverse 
weighting (IW) section 14. Then, required resolution 
conversion in the orthogonal transform domain (fre- 
quency domain) is carried out on the inversely weighted 
video signal by a resolution converting section 16. After 
that, the video signal having the resolution converted is 
weighted by a weighting (W) section 18, then quantized 
by a quantizing (Q) section 19. coded by variable-length 
coding by a variable-length coding (VLC) section 20. 
and outputted as a digital signal of a second format 
(MPEG video signal). 
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Description 

Technical Field 

5 



[0001 ] This invention relates to conversion processing of digital signals compression-coded by using o^hogona 
transform such as discrete cosine transform (DCT). and particularly to a digital signal convers-on method and a d.grtal 
signal conversion device for converting the resolution between compressed video signals of different formats. 
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Background Art 

[0002] Conventionally, discrete cosine transform (DCT). which is a kind of orthogonal transform coding has been 
used as a coding system for efficiently compression-coding still picture data and dynam.c picture data. In handling such 
digital signals on which orthogonal transform has been carried out. it is sometimes necessary to change the resolution 

r00M] Sf °For b ia^ple. in the case where a first orthogonally transformeddigital signal having a resolution of 720x480 
pixels as an example of home digital video format is to be converted to a second orthogonally transformed dig.tal s.gnal 
having a resolution of 360x240 pixels of a so-called MPEG1 format, inverse orthogonal transform is earned out on the 
first signal to restore a signal on the spatial domain, and then transform processing such as interpolation and th.nn.ng 
is carried out to perform orthogonal transform again, thus converting the first signal to the second s.gnal. 
[00041 In this manner, it is often the case that the orthogonally transformed digital signal is inversely transformed once 
to restore the original signal, then processed by required transform operations, and then orthogonally transformed 

[0005] Fig 28 shows an exemplary structure of a conventional digital signal processing device for carrying out reso- 
lution conversion as described above with respect to digital signals on which DCT has been earned out 
[0006] In this conventional digital signal conversion device, a video signal (hereinafter referred to as DV video signal) 
of a so-called "DV format", which one format of home digital video signals, is inputted as a digital signal of a 1 M format, 
and a video signal (hereinafter referred to as MPEG video signal) of a format in conformity to the so-called MPEG (Mov- 
ina Picture Experts Group) standard is outputted as a digital signal of a second format. 

[0007] A de-framing section 51 is adapted for cancelling framing of the DV video signal. In this de-f rammg section 51 . 

30 the DV video signal framed in accordance with the so-called DV format is restored to a var.able-length code. 

[0008] A variable-length decoding (VLD) section 52 carries out variable-length decoding of the video s.gnal restored 
to the variable-length code by the de-framing section 51. The compressed data in the DV format is compressed at a 
fixed rate so that its data quantity is reduced to approximately 1/5 of that of the original signal, and .s coded by vanable- 
length coding so as to improve the data compression efficiency. The variable-length decoding section 52 cames out 

35 decoding corresponding to such variable-length coding. 

[0009] An inverse quantizing (IQ) section 53 inversely quantizes the video signal decoded by the vanable-length 

[OOl^r^n^ere^weighting (IW) section 54 carries out inverse weighting, which is the reverse operation of weighting 
carried out on the video signal inversely quantized by the inverse quantizing section 53. 

[001 1 ] The weighting operation is to reduce the value of DCT coefficient for higher frequency components of the video 
signal by utilizing such a characteristic that the human visual sense is not very acute to a distortion on the high-fre- 
quency side. Thus, the number of high-frequency coefficients having a value of 0 is increased and the variable-length 
coding efficiency can be improved. As a result, the quantity of arithmetic operation of the DCT transform can be reduced 
in some cases. 

[001 2] An inverse discrete cosine transform (IDCT) section 55 carries out inverse DCT (inverse discrete cosine trans- 
form) of the video signal which is inversely weighted by the inverse weighting section 54. and thus restores the DCT 
coefficient to data of the spatial domain, that is, pixel data. 

[001 3] Then, a resolution converting section 56 carries out required resolution conversion with respect to the video 
signal restored to the pixel data by the inverse discrete cosine transform section 55. 

[001 4] A discrete cosine transform (DCT) section 57 carries out discrete cosine transform (DCT) of the video signal 
which is resolution-converted by the resolution converting section 56. and thus converts the video signal to an orthog- 
onal transform coefficient (DCT coefficient) again. 

[0015] A weighting (W) section 58 carries out weighting of the video signal which is resolution-converted and con- 
verted to the DCT coefficient. This weighting is the same as described above. 
[001 6] A quantizing (Q) section 59 quantizes the video signal weighted by the weighting section 58. 
[001 7] Then, a variable-length coding (VLC) section 60 carries out variable-length coding of the video signal quan- 
tized by the quantizing section 59 and outputs the resultant signal as an MPEG video signal. 

[001 8] The above-described "MPEG" is an abbreviation of the Moving Picture Experts Group of ISO/IEC JTC1/SC29 
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(International Organization for Standardization/International Electrotechnical Commission, ^J^^^T^ B 
1/Sub Committee 29). There are an IS011172 standard as the MPEG1 standard and an IS01 381 8 standard as the 
MPEG2 standard. Among these international standards. IS011172-1 and IS013818-1 are standardized in hemuttime- 
dia multiplexing section, and ISO1 1172-2 and IS013818-2 are standardized in the video section, while IS01 1172-3 
5 and IS013818-3 are standardized in the audio section. 

[001 91 In accordance with IS01 11 72-2 or IS01 381 8-2 as the picture compression coding standard, an image signal 
is compression-coded on the picture (frame or field) basis by using the correlation of pictures in the time or spatial d.rec- 
tion and the use of the correlation in the spatial direction is realized by using DCT coding. 

[0020] In addition, this orthogonal transform such as DCT is broadly employed for various types of picture information 
w compression coding such as JPEG (Joint Photographic Coding Experts Group). 

[0021 1 In general orthogonal transform enables compression coding with high compression eff iciency and excellent 
reproducibility by converting an original signal of the time domain or spatial domain to an orthogonally transformed 
domain such as the frequency domain. . 
[0022] The above^escribed "DV format" is adapted for compressing the data quantity of digital video signals to 
approximately 1/5 for component recording onto a magnetic tape. The DV format is used for home digital video devices 
and some of digital video devices for professional use. This DV format realizes efficient compression of video signals 
by combining discrete cosine transform (DCT) and variable-length coding (VLC). 

[0023] Meanwhile a large quantity of calculation is generally required for orthogonal transform such as discrete 
cosine transform (DCT) and inverse orthogonal transform. Therefore, there arises a problem that resolution conversion 
of video signals as described above cannot be carried out efficiently. Also, since errors are accumulated by increase in 
the quantity of calculation, there arises a problem of deterioration in signals. 

Disclosure of the Invention 

25 [0024] In view of the foregoing status of the art. it is an object of the present invention to provide a digital signal con- 
version method and a digital signal conversion device which enable efficient conversion processing such as resolution 
conversion with less deterioration in signals by reducing the quantity of arithmetic processing of the data quantity of sig- 
nals which are processed by resolution conversion for conversion to a different format. 

[0025] In order to solve the foregoing problems, a digital signal conversion method according to the present invention 

30 includes: a data extraction step of extracting a part of orthogonal transform coefficients from respective blocks off a dig- 
ital signal of a first format consisting of orthogonal transform coefficient blocks of a predetermined unit thus constituting 
partial blocks; an inverse orthogonal transform step of carrying out inverse orthogonal transform of the orthogonal 
transform coefficients constituting each partial block, on the partial block basis; a partial block connection step of con- 
necting the partial blocks processed by inverse orthogonal transform, thus constituting a new block of the predeter- 

35 mined unit; and an orthogonal transform step of orthogonally transforming the new block on the block basis, thus 
generating a second digital signal consisting of the new orthogonal transform block of the predetermined unit 
[0026] Also, in order to solve the foregoing problems, a digital signal conversion method according to the present 
invention includes: an inverse orthogonal transform step of carrying out inverse orthogonal transform of a digital signal 
of a first format consisting of orthogonal transform coefficient blocks of a predetermined unit, on the block basis; a block 

40 division step of dividing each block of the digital signal of the first format processed by inverse orthogonal transform; an 
orthogonal transform step of orthogonally transforming orthogonal transform coefficients constituting each divided 
block, on the divided block basis; and a data enlargement step of interpolating each orthogonally transformed block with 
an orthogonal transform coefficient of a predetermined value to constitute the predetermined unit, thus generating a 
digital signal of a second format. 

45 [0027] Also, in order to solve the foregoing problems, a digital signal conversion device according to the present inven- 
tion includes: decoding means for decoding a digital signal of a first format consisting of orthogonal transform coeffi- 
cients of a predetermined unit; inverse quantization means for inversely quantizing the decoded digital signal ; resolution 
conversion means for extracting a part of the orthogonal transform coefficients from adjacent blocks of orthogonal 
transform coefficient blocks of the predetermined unit of the inversely quantized digital signal, thus constituting partial 

so blocks, and converting the resolution; quantization means for quantizing the digital signal processed by resolution con- 
version; and coding means for coding the quantized digital signal, thus generating a digital signal of a second format. 
[0028] Also, in order to solve the foregoing problems, a digital signal conversion device according to the present inven- 
tion includes: decoding means for decoding a digital signal of a first format compression -coded by using orthogonal 
transform; inverse quantization means for inversely quantizing the decoded digital signal; resolution conversion means 

55 for interpolating each predetermined block of the inversely quantized digital signal with an orthogonal transform coeffi- 
cient of a predetermined value, thus constituting a predetermined unit, and converting the resolution; quantization 
means for quantizing the digital signal processed by resolution conversion; and coding means for coding the quantized 
digital signal, thus generating a digital signal of a second format. 
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[00291 Also, in order to solve the foregoing problems, a digital signal conversion method according to the present 
invention is adapted for converting a digital signal of a first format consisting of orthogonal transform coefficient b octe 
of a predetermined unit to a digital signal of a second format consisting of new orthogonal transform coefficient blocks 
of another predetermined unit. In this method, the data quantity of the digital signal of the second format is controlled 
by utilizing data quantity information included in the digital signal of the first format. 

[00301 Also in order to solve the foregoing problems, a digital signal conversion device according to the present inven- 
tion is adapted for converting a digital signal of a first format consisting of orthogonal transform coefficient blocks of a 
predetermined unit to a digital signal of a second format consisting of new orthogonal transform coefficient blocks of 
another predetermined unit. This device includes: decoding means for decoding the digital signal of the first format; 
inverse quantization means for inversely quantizing the decoded digital signal : signal conversion means for carrying out 
signal processing accompanying format conversion of the inversely quantized digital signal; quantization means for 
quantizing the digital signal processed by signal processing; data quantity control means for controlling the data quan- 
tity in the quantization means; and coding means for coding the digital signal which is quantized and has its data quan- 
tity controlled by the data quantity control means, thus generating the digital signal of the second format. 
[00311 Also in order to solve the foregoing problems, a digital signal conversion method according to the present 
invention is adapted for converting a digital signal of a first format to a digital signal of a second format. Th.s method 
includes- a decoding step of decoding the digital signal of the first format; a signal conversion step of converting the 
decoded digital signal of the first format to the digital signal of the second format; a coding step of coding the digital sig- 
nal of the second format; and a weighting processing step of collectively carrying out inverse weighting for the digital 
signal of the first format and weighting for the digital signal of the second format. 

[0032] Also in order to solve the foregoing problems, a digital signal conversion device according to the present inven- 
tion is adapted for converting a digital signal of a first format to a digital signal of a second format. Th.s device includes: 
decoding means for decoding the digital signal of the first format; signal conversion means for converting the decoded 
digital signal of the first format to the digital signal of the second format; coding means for coding the digital signal o 
the second format; and weighting processing means for collectively carrying out inverse weight.ng for the digital signal 
of the first format and weighting for the digital signal of the second format. 

[0033] Also in order to solve the foregoing problems, according to the present invention, decoding along with motion 
compensation is carried out on an input information signal compression-coded along with motion detection and signal 
conversion processing is carried out on this decoded signal. The compression coding processing is carried out on the 
converted signal along with motion detection based on motion vector information of the input information signal. 
[0034] Also in order to solve the foregoing problems, according to the present invention, partial decoding processing 
is carried out on an input information signal processed by compression coding including predictive coding along with 
motion detection and orthogonal transform coding, thus obtaining a decoded signal of the orthogonal transform domain. 
Then signal conversion processing is carried out on the decoded signal of the orthogonal transform domain, and com- 
pression coding processing along with motion compensation prediction is carried out on the converted signal by using 
motion detection based on motion vector information of the input information signal. 

[0035] Also in order to solve the foregoing problems, according to the present invention, partial decoding processing 
is carried out' on an input information signal processed by compression coding including predictive coding alongwith 
motion detection and orthogonal transform coding, thus obtaining a signal of the orthogonal transform domain. Then 
signal conversion processing is carried out on the signal, and compression coding is carried out on the converted signal 
by adding motion vector information converted on the basis of motion vector information of the input information signal. 
[0036] Also in order to solve the foregoing problems, according to the present invention, a digital signal of a first for- 
mat to which dynamic mode/static mode information is added in advance is decoded, and signal conversion processing 
is carried out on the decoded signal. Then, whether or not to carry out inter-frame differential coding for each predeter- 
mined block of the converted signal is discriminated in accordance with the dynamic mode/static mode information. 
Coding is carried out on the converted signal on the basis of the result of discrimination, and a digital signal of a second 
format processed by coding using the inter-frame difference is outputted. 

[0037] Also in order to solve the foregoing problems, according to the present invention, partial decoding processing 
is carried out on a digital signal of a first format, thus obtaining a signal of the orthogonal transform domain. Signal con- 
version processing is carried out on the signal of the orthogonal transform domain, and whether or not to carry out inter- 
frame differential coding for each predetermined block of the converted signal is discriminated in accordance with the 
maximum value of the absolute value of the inter-frame difference of the converted signal. The converted signal is 
coded on the basis of the result of discrimination, and a digital signal of a second format is outputted. 
[0038] Moreover in order to solve the foregoing problems, according to the present invention, with respect to a digital 
signal of a first format including an intra-frame coded signal processed by intra-frame coding and a forward predictive 
coded signal and a bidirectional^ predictive coded signal processed by forward and bidirectional inter-frame predictive 
coding along with motion detection, inverse orthogonal transform is carried out on the intra-frame coded signal and the 
forward predictive coded signal. A motion compensation output to be added to the partially decoded forward predictive 
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coded signal and bidirectionally predictive coded signal is generated on the basis of the inverse orthogonal transform 
output. The motion compensation output is orthogonally transformed, and the orthogonal transform output is added to 
the partially decoded forward predictive coded signal and bidirectionally predictive coded signal. Compression coding 
is carried out on a signal based on the addition output, and a digital signal of a second format is outputted. 

Brief Description of the Drawings 

[0039] 

Fig. 1 is a block diagram showing an exemplary structure of a digital signal conversion device according to a first 
embodiment of the present invention. 

Fig.2 illustrates the principle of resolution conversion in the orthogonal transform domain. 
Fig. 3 illustrates the principle of resolution conversion in the orthogonal transform domain. 

Figs.4A to 4C schematically show the state where a DV video signal is converted to an MPEG video signal by digital 
signal conversion according to the first embodiment of the present invention. 

Fig. 5 illustrates the relation between the DV format and the MPEG format. 

Fig. 6 illustrates the basic calculation procedure for resolution conversion processing. 

Figs.7A and 7B illustrate a "static mode" and a "dynamic mode" of the DV format 

Fig. 8 illustrates the procedure of conversion processing in the "static mode". 

Figs.9A to 9C are block diagrams showing an exemplary structure of a digital signal conversion device according 
to a second embodiment of the present invention. 

Fig. 10 illustrates the procedure of conversion processing in enlargement of an image. 

Fig. 1 1 is a block diagram showing an exemplary structure of a digital signal conversion device according to a third 
embodiment of the present invention. 

Fig. 12 is a block diagram showing an exemplary structure of a digital signal conversion device according to a fourth 
embodiment of the present invention. 

Fig. 13 is a block diagram showing an exemplary structure of a digital signal conversion device according to a fifth 
embodiment of the present invention. 

Fig. 14 is a block diagram showing an exemplary structure of a digital signal conversion device according to a sixth 
embodiment of the present invention. 

Fig. 15 is a block diagram showing an exemplary structure of a digital signal conversion device according to a sev- 
enth embodiment of the present invention. 

Fig. 16 is a flowchart showing the basic procedure for setting the quantizer scale for each macroblock (MB) of each 
frame when a DV video signal is converted to an MPEG signal in the seventh embodiment of the present invention. 

Fig. 1 7 is a flowchart showing the basic procedure for applying feedback to a next frame by using the preset quan- 
tizer scale in the seventh embodiment of the present invention. 

Fig. 18 is a block diagram showing an exemplary structure of a conventional digital signal conversion device for con- 
verting an MPEG video signal to a DV video signal. 

Fig. 19 is a block diagram showing an exemplary structure of a digital signal conversion device according to an 
eighth embodiment of the present invention. 
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Fig.20 is a block diagram showing an exemplary structure of a digital signal conversion device according to a ninth 
embodiment ol the present invention. 

Fig.21 is a block diagram showing an exemplary structure of a digital signal conversion device according to a tenth 
5 embodiment of the present invention. 

Fig.22 is a block diagram showing an exemplary structure of a digital signal conversion device according to a elev- 
enth embodiment of the present invention. 

Fig.23 is a block diagram showing an exemplary structure of a digital signal conversion device according to a twelfth 
embodiment of the present invention. 

Fia 24 illustrates motion compensation and motion estimation processing in the orthogonal transform domain in the 
Sh "Segment of the present invention, and shows the state where a macroblock B extends over a plurality of 
is macroblocks of a reference picture. 

Fig 25 illustrates motion compensation and motion estimation processing in the orthogonal transform domain in the 
twelfth embodiment of the present invention, and shows conversion processing of a reference macroblock. 

20 Fig 26 illustrates motion compensation and motion estimation processing in the orthogonal transform domain in the 
Sfth embodiment of the present invention, and shows the procedure of conversion of the reference macroblock. 

Fig.27 is a block diagram showing an exemplary structure of a digital signal conversion device according to a thir- 
teenth embodiment of the present invention. 

Fig.28 is a block diagram showing an exemplary structure of a conventional digital signal conversion device. 
Best Mode for Canying Out the Invention 

[0040] Preferred embodiments of the present invention will now be described with reference to the ^wings. 
0041 First the structure of a digital signal conversion device according to the present invention wll be described. 
an?then TS/SS^ conversion method according to the present invention will be described with reference to the 

moS^Fig 1 shows an exemplary structure of essential portions of a digital signal conversion device as a first embod- 
iment of the present invention. Although signal conversion is exemplified by resolution conversion, rt .s a t matter of 
course that signal conversion is not limited to resolution conversion and that various types of s.gnal processing such as 
format conversion and filter processing can be employed. j.w«„k~_ 
SmS m this digital signal conversion device, a video signal (hereinafter referred to as DV video signage the a£ve- 
described so-called "DV format" is inputted as a first digital signal, and a video signal (hereinafter referred to as MPEG 
video signal) of a format in conformity to the MPEG (Moving Picture Experts Group) standard is outputted as a second 

fooSl^Ade-f raming section 1 1 is adapted for cancelling framing of the DV video signal. In this de-framing section 1 1 , 
the DV video signal framed in accordance with the predetermined format (so-called DV format) .s restored to a vanable- 

[0045] ^variable-length decoding (VLD) section 1 2 carries out variable-length decoding of the video signal restored 
to the variable-length code by the de-framing section 11. „ =riah i a , ann », 

[0046] An inverse quantizing (IQ) section 13 inversely quantizes the video Signal decoded by the variable-length 

?o e o^ n9 A^le n rse 2 weighting (IW) section 14 carries out inverse weighting, which is the reverse operation of weighting 
carried out on the video signal inversely quantized by the inverse quantizing section 13. 

[0048] In the case where resolution conversion is carried out as an example of signal conversion processing, a reso- 
lution converting section 16 carries out required resolution conversion in the orthogonal transform domain (frequency 
domain) with respect to the video signal inversely weighted by the inverse weighting section 14. 
[0049] A weighting (W) section 1 8 canies out weighting of the video signal processed by resolution conversion. 
[0050] A quantizing (Q) section 19 quantizes the video signal weighted by the weighting section 18 
[0051 ] Then a variable-length coding (VLC) section 20 carries out variable-length coding of the video s.gnal quan- 
tized by the quantizing section 19 and outputs.the resultant signal as an MPEG video signal. 

[0052] The structure of each part of the above-described digital signal conversion device according to the present 
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invention shown in Fig. 1 can be made similar to the structure of each part of the conventional digital signal conversion 
device shown in Fig.28. 

[0053] However, this digital signal conversion device according to the present invention differs from the conventional 
digital signal conversion device in that an inverse discrete cosine transform (IDCT) section and a discrete cosine trans- 
form (DOT) section are not provided before and after the resolution converting section 16. 

[0054] That is, in the conventional digital signal conversion device, the orthogonal transform coefficient of the inputted 
digital signal of the first format is inversely orthogonally transformed to be restored to data in the spatial domain (on the 
frequency base), and then required conversion operation is carried out. Therefore, orthogonal transform is carried out 
again to restore the data to the orthogonal transform coefficient. 

[0055] On the contrary, in the digital signal conversion device according to the present invention, required conversion 
operation of the orthogonal transform coefficient of the inputted digital signal of the first format is carried out in the 
orthogonal transform coefficient domain (frequency domain), and inverse orthogonal transform means and orthogonal 
transform means are not provided before and after the means for carrying out conversion processing such as resolution 
conversion. . 

[0056] The principle of resolution conversion processing in the resolution converting section 16 will now be described 
with reference to Figs.2 and 3. . n 

[0057] In Fig.2. an input orthogonal transform matrix generating section 1 generates an inverse matrix Ts^) of an 
orthogonal transform matrix Ts (k) expressing orthogonal transform that has been carried out on an input digital signal 
5 in advance, and sends the inverse matrix to a transform matrix generating section 3. An output orthogonal transform 
matrix: generating section 2 generates an orthogonal transform matrix: Td^ corresponding to an inverse transform 
matrix Td (L) * 1 expressing inverse orthogonal transform that is to be carried out on an output digital signal, and sends 
the orthogonal transform matrix to the transform matrix generating section 3. The transform matrix generating section 
3 generates a transform matrix D for carrying out conversion processing such as resolution conversion in the frequency 
domain, and sends the transform matrix to a signal converting section 4. The signal converting section 4 converts the 
input digital signal 5 that has been converted to the frequency domain by orthogonal transform while maintaining the 
orthogonally transformed domain such as the frequency domain, and generates an output digital signal 6. 
[0058] Specifically, as shown in Fig.3. a signal (original signal) A of the original time domain (or spatial domain) is 
converted to the frequency domain by using the orthogonal transform matrix: Ts^ to generate a frequency signal B 1 
(corresponding to the input digital signal 5). This frequency signal B 1 is contracted to N/L (or enlarged) by the signal 
converting section 4 to generate a frequency signal B 2 (corresponding to the output digital signal 6). This frequency sig- 
nal B 2 is inversely orthogonally transformed by using the inverse transform matrix: Td {L) * 1 to generate a signal C of the 
time domain. 

[0059] In the example of Fig.3. the one-dimensional original signal A is orthogonally transformed for each conversion 
block having a length of k, and m units of adjacent blocks of the resultant conversion blocks of the frequency domain, 
that is, continuous frequency signals having a length of L (= kxm) , are converted to one block having a length of N 
(where N < L), that is. contracted to N/L as a whole. 

[0060] In the following description, a matrix (orthogonal transform matrix) in which orthogonal transform base vectors 
e 1f es. .... e„ having a length of n are arranged in the respective rows is expressed as T (n) , and an inverse transform 
matrix thereof is expressed as T (n) " 1 . In this description, x denotes an x vector expression, in this case, each matrix: is 
an n-order forward matrix. For example, a one-dimensional DCT transform matrix T (8) where n = 8 holds is expressed 
by the following equation (1). 
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[0061 ] In Fig.3, when the size of the orthogonal transform block with respect to the input digital signal 5 that has been 
orthogonally transformed to the frequency domain by using the orthogonal transform matrix Ts^ is k, that is, when the 
base length is equal to k, the input orthogonal transform matrix generating section 1 generates the inverse orthogonal 



8 



10 



EP0 951 184 A1 

transform matrix T S(k) \ and the output orthogonal transform matrix generating section 2 generates the orthogonal 
transform matrix Td (L) having the base length of L (= kxm) . 

[0062] At this point, the inverse orthogonal transform matrix T S(k) 1 generated by the input orthogonal transform matnx 
generating section 1 corresponds to inverse processing of orthogonal transform processing in generating the input dig- 
ital signal 5. and the orthogonal transform matrix Td (L) generated by the output orthogonal transform matnx generating 
section 2 corresponds to inverse processing of inverse orthogonal transform processing .n decodmg the output digrtal 
signal converted by the signal converting section 4. that is. in converting the signal to the time domain. Both these 
orthogonal transform matrix generating sections 1 and 2 can generate base vectors of arbitrary lengths. 
[0063] The orthogonal transform matrix generating sections 1 and 2 may be identical orthogonal transform matrix 
generating sections. In such case, the orthogonal transform matrices T S(k) and Td^ become orthogonal transform 
matrices of the same type, with their base lengths alone differing from each other. The orthogonal transform matrix gen- 
erating section exists for each of different orthogonal transform systems. 

[0064] Next the transform matrix generating section 3 generates an L-order forward matrix A by arranging, on the 
diagonal, m units of inverse orthogonal transform matrices T S(k) - 1 generated by the input orthogonal fransform matrix 
generating section 1, as expressed by the following equation (2). When the base length of the output digrtal signal 6 is 
equal to N. the transform matrix generating section 3 takes out N units of low-frequency base vectors of the orthogonal 
transform matrix Td (L) and generates a matrix B consisting of N rows and L columns. 
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[0065] In this expression, however, ftl , e^ are units of low-frequency base vectors when Td (L) is expressed by 

base vectors as follows. 
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is [0066] Then, an equation of 

D = a • B • A (5) 

is calculated to generate the matrix D consisting of N rows and L columns. This matrix D is a transform matrix for con- 
20 verting the resolution at the contraction rate (or enlargement rate) of N/L. In this equation, a is a scalar value or vector 
value and is a coefficient for level correction. 

[0067] The signal transforming section 4 of Fig.2 collects m blocks of an input digital signal of the frequency domain 
into a group, and divides the signal into meta-blocks having a size L (where one meta-block consisting of m blocks), as 
shown in Fig.3. If the length of the input digital signal B 1 is not a multiple of U the signal is supplemented and stuffed 
25 with dummy data such as 0 to make a multiple of L The meta-blocks thus generated are expressed by Mi (where i = 0, 

1,2,...). 

[0068] The above-described principle of resolution conversion processing is described in detail in PCT/JP98/02653 
filed by the present Assignee on 16 June 1998. 

[0069] A digital signal conversion method of the first embodiment will now be described with reference to the structure 

30 of the above-described digital signal conversion device. 

[0070] Figs.4A to 4C schematically show processing in converting a DV video signal to an MPEG video signal by dig- 
ital signal conversion of the embodiment of the present invention. This processing is carried out mainly by the resolution 
converting section 16 in the digital signal processing device of the embodiment of the present invention shown in Fig.1 . 
[0071] In the following description, a one-dimensional DCT coefficient block is used as an example. However, 

35 processing for two-dimensional DCT coefficients is similarly carried out. 

[0072] First, four DCT coefficients on the low-frequency side are taken out from each of adjacent blocks (i) and (i+1), 
each consisting of eight DCT coefficients of the digital signal of the first format as shown in Fig.4A. That is, from among 
eight DCT coefficients aO, al , a2, a3 a7 of the block (i), only the four DCT coefficients aO, a1 , a2 and a3 on the low- 
frequency side are taken out, and a partial block having the number of DCT coefficients reduced to 1/2 is produced. 

40 Similarly, from among eight DCT coefficients b0, b1 , b2, b3 b7 of the block (i+1). only the four DCT coefficients bO, 

bl. b2 and b3 on the low-frequency side are taken out. and a partial block having the number of DCT coefficients 
reduced to 1/2 is produced. The operation of taking out the DCT coefficient on the low-frequency side is based on such 
a characteristic that the energy is concentrated to low frequencies of DC and AC when the video signal is frequency- 
converted. 

45 [0073] Then. 4-point inverse discrete cosine transform (4-point I DCT) is carried out on each partial block consisting 
of four DCT coefficients, thus obtaining contracted pixel data. These pixel data are expressed as pixel data p0. p1 , p2, 
p3 and pixel data p4, p5, p6, p7 in Fig.4B. 

[0074] Next, the partial blocks, each consisting of the contracted pixel data processed by inverse discrete cosine 
transform, are coupled to generate a block having the same size as the original block. That is, the pixel data pO. p1 , p2. 

so p3 and the pixel data p4, p5, p6, p7 are coupled to generate a new block consisting of eight pixel data. 

[0075] Then, 8-point discrete cosine transform (8-point DCT) is carried out on the new block consisting of eight pixel 

data, thus generating one block (j) consisting of eight DCT coefficients cO, c1 , c2, c3 c7, as shown in Fig.4C. 

[0076] Through the procedures as described above, a video signal can be converted to a video signal of a format of 
different resolution by thinning the number of orthogonal transform coefficients (DCT coefficients) per predetermined 

55 block unit to half. When the number of DCT coefficients is to be thinned to 1/4, the above-described processing is car- 
ried out continuously twice. 

[0077] The above-described resolution conversion processing can be applied to. for example, conversion from the DV 
format to the MPEG 1 format. 
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[0078] The relation between the DV format and the MPEG format and format conversion between these formats will 
now be described with reference to Fig. 5. . 
f00791 Soecif ically in the case of a video signal in conformity to the NTSC system as shown in Fig.5. a v,deo signal 
Tthe DV fonraHs a compressed video signal having a resolution of 720,480 pixels and a ratio of the samphng fre- 
auInJ ^SCSliJSSt; the sampling frequencies of two color-difference signals equal to 4:1 :1 A ( Vdeo signal 
of the M?EG1^mTt is a compressed video signal having a resolution of 360x240 pixels and a rate . * the sampling 
?JTupnl« ofa usance stanal to the sampling frequencies of two color-difference signals equal to 4:2:0. Therefore, 
S cas * J. nZoer of DCT coefficient *e horizontal and vertica. directions of the luminance <Y) signa may be 
eouceJto l^ andThe number of OCT coefficients in the vertical direction of the color-diHerence (C) s,gna. may be 
reduced to 1/4 by the above^Jescribed resolution conversion processing according to the presert .wert.on. 
jXof The r Z of 4 2:0 represents the value of either an odd line or an even line since the odd l,ne and the even hne 

sTcompressed video signal having a resolution of 720x576 pixels and a ratio of the samphng frequency of a ur^nance 
signage sampling frequencies of two color-difference signals equal to 4:2:0. A video s.gna. of the MPEG 1 fonrat * 
a comoressed vtfeo signal having a resolution of 360x288 pixels and a ratio of the samphng frequency of a lum.nance 
signXThelarnpTng frequencies of two color-difference signals equal to 4:2:0. Therefore, in th.s ^case. the number of 
OCT coefficierts ?n the horizontal and vertical directions of the Y signal may be reduced to 1/2 and the number of DCT 
coemSteTn te horizontal and vertica. directions of the C signa. may be reduced to 1 a by the above-desenbed res- 

olution conversion processing according to the present invention. ^ rmst 

°008 2 ] The above-described resolution conversion processing can similarly applied to conversion from the DV format 

lou8 3 r^nS 1 case i of a video signal in conformity to the NTSC system, a video signal of the MPEG2 format is a com- 
p°Sed £S Jlg a resolution of 720x480 pixels and a ratio of the sampling frequency * > ""^ -*« 
toTe Sampling frequencies of two color<iifference signals equal to 4:2:0. Therefore, .n th.s case the number of DCT 
SS^STStal direction of the C signa. may be reduced to 1/2 and the number of DCT f coefl M , « the 
horizontal direction of the C signal may be doubled, without carrying out conversion process.ng of the Y s.gnal. The 

method for this enlargement will be described later. , 

KEf In *e case of a video signal in conformity to the PAL system, a video signal of the MPEG2 format .s a com- 
pressed video signal having a resolution of 720x576 pixels and a ratio of the sampling frequency of a lum.nance s.gnal 
t^tSamphng frequencies of two color<hfference signals equal to 42:0. Therefore, in this case, convers.cn process- 
ing need not be carried out with respect to either the Y signal or the C signal. or _ oeclr , n 
[00851 Fig 6 shows the basic calculation procedure for the above^lescribed resolution convers.on process.ng. 
0086 Specifically, the block consisting of eight DCT coefficients, produced by connecting tour DCT «,eff 'C'ents aO 
a1 a2 a3 and four DCT coefficients bO. b1 . b2. b3 taken out from the two adjacent blocks of the .nputted digital signal 
of the first format, is multiplied by an (8x8) matrix including two inverse discrete cosine transform matnees (IDCT4) on 
the diaoonal each being provided as a (4x4) matrix, and having 0 as other components. 

0087? The product thereof is further multiplied by a discrete cosine transform matrix (DCT8) prov,ded as an (8x8) 

matrix and a new block consisting of eight DCT coefficients cO. d , c2. c3 c7 .s generated. 

r00881 In the digital signal conversion method according to the present invention, since resolution wrwersion process- 
ing is carried out in the DCT domain (frequency domain), inverse DCT before resolution conversion and DCT after res- 
olution conversion are not necessary. In addition, by finding the product of the (8x8) matnx mclud.ng the two (4x4) 
inverse discrete cosine transform matrices (IDCT4) on the diagonal and the (8x8) discrete cosine transform matr.x as 
a transform matrix D in advance, the quantity of arithmetic operation can be effectively /educed- 
; [0089] The processing for converting the DV video signal as the digital signal of the first format to the MPEG1 video 
signal as the digital signal of the second format will be described further in detail. 

[0090] The DV format has a "static mode" and a "dynamic mode" which are switched in accordance with .the result of 
motion detection of pictures. For example, these modes are discriminated by motion detection before DCT of each 
(8x8) matrix in a video segment, and DCT is carried out in either one mode in accordance with the result of °'*=r.m.na- 
> lion Various methods for motion detection may be considered. Specifically, a method of comparing the sum of absolute 
values of inter-field differences with a predetermined threshold value may be employed. Kl 
[0091 ] The "static mode" is a basic mode of the DV formal, in which (8x8) DCT is carried out on (8x8) p.xels .n a block. 
f00921 The (8x8)-block is constituted by one DC component and 63 AC components. 

0093] The "dynamic mode" is used for avoiding such a case that if DCT is carried out when an object is movrng. the 
s compression efficiency is lowered by dispersion of energy due to interlace scanning. In this dynam.c mode, an (8x8)- 
block is divided into a <4x8)-block of a first field and a (4x8)-block of a secondfield. and (4x8) DCT .s earned out on the 
pixel data of each (4x8)-block. Thus, increase in high-frequency components in the vertical direction is restra.ned and 
the compression rate can be prevented from being lowered. 
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[0094] Each (4x8)-block as described above is constituted by one DC component and 31 AC components. 
[0095] Thus in the DV format, the block structure differs between the static mode and the dynamic mode. Therefore, 
in order to enable similar processing for the subsequent processing, an (8x8)-block is constituted with respect to the 
block of the dynamic mode by finding the sum and difference of the coefficients of the same order of each block after 
5 DCT of each (4x8)-block. By such processing, the block of the dynamic mode can be regarded as being constituted by 
one DC component and 63 AC components, similarly to the block of the static mode. 

[0096] Meanwhile, in converting the video signal of the DV format to the video signal of the MPEG1 format, it is nec- 
essary to separate only one field since the MPEG1 format only handles a video signal of 30 frames/sec and has no con- 
cept of field. 

10 [0097] Fig.7A schematically shows processing for separating fields in converting DCT coefficients in accordance with 
the "dynamic mode (2x4x8 DCT mode)" of the DV format to DCT coefficients of the MPEG1 format 
[0098] An upper-half (4x8)-block 31 a of a DCT coefficient block 31 of (8x8) is the sum (A+B) of coefficients of a first 
field and coefficients of a second field, and a lower-half (4x8)-block 31b of the DCT coefficient block 31 of (8x8) is the 
difference (A-B) of the coefficients of the two fields. 

is [0099] Therefore, by adding the upper-half (4x8)-bIock 31 a and the lower-half (4x8) -block 31 b of the DCT coefficient 
block 31 of (8x8) and then dividing the sum by 2, a (4x8)-block 35a consisting of the DCT coefficients of the first field 
(A) can be obtained. Similarly, by subtracting the lower-half (4x8)-block 31b from the (4x8)-block 31a and then dividing 
the difference by 2. a (4x8)-block 35b consisting of the discrete cosine coefficients of the second field (B) can be 
obtained. That is, by this processing, an (8x8)-block 35 having the separated fields can be obtained. 

20 [0100] Then, the above-described resolution conversion processing is carried out on the DCT coefficients of one of 
these fields, for example, the first field. 

[0101 ] Fig.7B schematically shows the processing for separating fields in the "static mode (8x8 DCT mode)". 
[0102] In a DCT coefficient block 32 of (8x8), DCT coefficients of a first field (A) and DCT coefficients of a second 
field (B) are mixed. Thus, it is necessary to carry out conversion processing for obtaining a (4x8)-block 35a consisting 
25 of the first field (A) and a (4x8)-block 35b consisting of the second field (B) similarly through subtraction between the 
(4x8)-bIock 31a and the (4x8)-block 31b, by using field separation processing which will be described hereinafter. 
[0103] Fig.8 shows the procedure of field separation processing in the "static mode". 

[0104] First, an input consisting of eight DCT coefficients dO. d1 , d2, d3 d7 is multiplied by an 8th-order inverse 

discrete cosine transform matrix (IDCT8). thus restoring pixel data. 
so [01 05] Next, the data is multiplied by an (8x8) matrix for field separation, thus dividing the (8x8)-block into a first field 
on the upper side and a second field on the lower side, each being a (4x8)-block 

[0106] Tnen, the data is further multiplied by an (8x8)-block including two discrete cosine transform matrices (DCT4) 
on the diagonal, each being provided as a (4x4)-matrix. 

[0107] Thus, eight DCT coefficients consisting of four DCT coefficient eO, e1, e2. e3 of the first field and four DCT 
35 coefficients fO. f 1 . f2. f3 of the second field are obtained. 

[0108] Then, the above-described resolution conversion processing is carried out on the DCT coefficients of one of 
these fields, for example, the first field. 

[0109] In the digital signal conversion method according to the present invention, since resolution conversion is car- 
ried out in the DCT domain (frequency domain), inverse DCT before resolution conversion and DCT after resolution 
40 conversion are not necessary. In addition, by finding the product of the (8x8) matrix including the two (4x4) inverse dis- 
crete cosine transform matrices (IDCT4) on the diagonal and the (8x8) discrete cosine transform matrix in advance, the 
quantity of calculation can be effectively reduced. 

[0110] The above-described resolution conversion is for contracting an image. Hereinafter, resolution conversion 
processing for enlarging an image will be described as a second embodiment. 
45 [011 1] Figs.9A to 9C schematically show the state where a DV video signal is converted to an MPEG2 video signal 
by the digital signal conversion method according to the present invention. 

[01 1 2] Also in the following description, one-dimensional DCT coefficients are used. However, similar processing can 
be carried out on two-dimensional DCT coefficients. 

[0113] First, 8-point inverse discrete cosine transform (8-point IDCT) is carried out on a block (u) consisting of eight 
so orthogonal coefficients (DCT coefficients gO to g7) shown in Fig.9A, thus restoring eight pixel data (hO to h7). 

[0114] Next, the block consisting of eight pixel data is divided into two parts, thus generating two partial blocks each 
consisting of four pixel data. 

[011 5] Then, 4-point DCT is carried out on the two partial blocks each consisting of four DCT coefficients, thus gen- 
erating two partial blocks (i0 to i3 and jO to j3) each consisting of four DCT coefficients. 
55 [0116] Then, as shown in Fig.9C, the high-frequency side of each of the two partial blocks, each consisting of four 
pixel data, is stuffed with 0 as four DCT coefficients. Thus, a block (v) and a block (v+1) each consisting of eight DCT 
coefficients are generated. 

[01 1 7] In accordance with the above<iescribed procedure, resolution conversion between compressed video signals 
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of different formats is carried out in the orthogonal transform domain. 

[01 181 Fig 10 shows the procedure of conversion processing in this case. 

[0119] First, an input consisting of eight DCT coefficients gO. g1.g2.fl3 g7 is multiplied by an 8th-order inverse 

discrete cosine transform (IDCT) matrix, thus restoring eight pixel data. 

[01 20] Next, the block consisting of eight pixel data is divided into two parts, thus generating two partial blocks each 
consisting of four pixel data. 

[01 21 ] Then each of the two partial blocks, each consisting of four DCT coefficients, is multiplied by a (4x8)-matrix 
including a 4-point discrete cosine transform matrix provided as a (4x4)-matrix on the upper side and a 0-matnx pro- 
vided as a (4x4)-matrix on the lower side. Thus, two partial blocks (iO to i7 and jO to ]7) including eight DCT coefficients 
are generated. 

[01 22] By such processing, two blocks of DCT coefficients are obtained from one block. Therefore, the resolution can 
be enlarged in the frequency domain. 

[01 23] In the case of the NTSC system, in order to convert the DV format to the MPEG2 format, rt is not necessary to 
carry out horizontal and vertical conversion of the luminance signal Y, but it is necessary to enlarge the color-difference 
signal C to a double in the horizontal direction and contract the color<lifference signal C to 1/2 in the vertical direction, 
as shown in Fig.5. Therefore, the above-described enlargement processing is used for resolution conversion of the 
color-difference signal C in the horizontal direction in converting the DV format to the MPEG2 format. 
[01241 Fig 1 1 shows an exemplary structure of essential portions of a digital signal conversion device according to a 
third embodiment of the present invention. The same parts of the structure as those of the first embodiment are denoted 
by the same reference numerals. The difference from the structure of Rg.1 is that the weighting section 18 and the 
inverse weighting section 14 are collectively provided as a weighting processing section 21 . 

[0125] Specifically, the weighting processing (I WW) section 21 collectively carries out inverse weighting, which is 
reverse operation of weighting performed on a DV video signal as an inputted digital signal of a first format, and weight- 
ing for an MPEG video signal as an outputted digital signal of a second format 

[0126] With such a structure, since inverse weighting processing for the inputted video signal of the first format and 
weighting processing for the outputted video signal of the second format can be collectively carried out, the quantity of 
calculation can be reduced in comparison with the case where inverse weighting processing and weighting processing 
are separately carried out. , 
[0127] In the digital signal conversion device of the third embodiment shown in Fig.1 1 . the weighting processing sec- 
tion 21 is provided on the subsequent stage to the resolution converting section 1 6. However, the weighting processing 
section may be provided on the stage preceding the resolution converting section 16. 

[0128] Fig 1 2 shows a digital signal conversion device according to a fourth embodiment of the present invention, in 
which a weighting processing section 22 is provided on the stage preceding the resolution converting section 16. The 
parts of the structure of this digital signal conversion device shown in Fig. 12 can be made similar to the respective parts 
of the digital signal conversion device of Fig.1 1 . 

[01 29] The weighting processing for collectively carrying out inverse weighting of the digital signal of the first format 
and weighting of the second digital signal and the above<lescribed weighting processing can be carried out before or 
after orthogonal transform such as discrete cosine transform (DCT). This is because arithmetic operations therefor are 
linear operations. 

[01 30] A digital signal conversion method and device according to a fifth embodiment of the present invention will now 
be described with reference to Fig.1 3. 

[0131 ] This digital video signal conversion device has a decoding section 8 for decoding the DV video signal, a reso- 
lution converting section 16 for carrying out resolution conversion processing for format conversion of the decoding out- 
put from the decoding section 8, a discriminating section 7 for discriminating whether or not to carry out forward inter- 
frame differential coding for each predetermined block unit of the conversion output from the resolution converting sec- 
tion 1 6 in accordance with the dynamic mode/static mode information, and a coding section 9 for coding the conversion 
output from the resolution converting section 16 on the basis of the result of discrimination from the discriminating sec- 
tion 7 and outputting the MPEG video signal, as shown in Fig. 13. 

[01 32] In the following description, the digital video signal conversion device constituted by these parts is employed. 
As a matter of course, the respective parts carry out processing of each step of the digital signal conversion method 
according to the present invention. 

[01 33] In the DV video signal inputted to this digital video signal conversion device, a mode flag (for example, one bit) 

as information indicating the static mode/dynamic mode is added to each DCT block in advance. 

[01 34] In this digital video signal conversion device, the discriminating section 7 discriminates whether or not to carry 

out forward inter-frame differential coding for each predetermined block unit of the conversion output from the resolution 

converting section 1 6 on the basis of the mode flag. This operation will be later described in detail. 

[0135] A de-framing section 11 extracts the mode flag indicating the static mode/dynamic mode and supplies the 

mode flag to the discriminating section 7. 
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[0136] A de-shuffling section 15 cancels shuffling which is carried out to uniform the information quantity in a video 
segment as a unit for length fixation on the DV coding side. 

[01 371 The discriminating section 7 includes an adder 27 and an I (l-picture)/P (P-picture) discriminating and deter- 
mining section 28. The adder 27 adds to the resolution conversion output a reference DCT coefficient as a negative 
i DCT coefficient stored in a flame memory (FM) section 24 as will be later described. The l/P discriminating and deter- 
mining section 28 to which the addition output from the adder 27 is supplied is also supplied with the mode flag indicat- 
ing the static mode/dynamic mode from the de-framing section 11. 

[01 381 The operation of the l/P discriminating and determining section 28 will now be described in detail. The conver- 
sion output from the resolution converting section 16 has 8x8 DCT coefficients as a unit. Four DCT coefficient blocks 
w each having 8x8 DCT coefficients are allocated to the luminance signal, and two DCT coefficient blocks are allocated 
to the color-difference signal, thus constituting one predetermined block from six DCT coefficient blocks in total. This 
predetermined block is referred to as a macroblock. 

[01 391 Meanwhile a P-picture assumes that the difference from the previous frame is simply taken. In the case of a 
still image the information quantity is reduced as the difference is taken. However, in the case of a dynamic image, the 
is information quantity is increased as the difference is taken. Therefore, if it is discriminated that the image is dynam,c 
from the mode flag indicating the static mode/dynamic mode, the macroblock is left as an l-picture so as not to increase 
the information quantity. If it is discriminated that the image is static, efficient coding can be carried out by taking the 
difference to make a P-picture. 

[01401 The l/P discriminating and determining section 28 uses an l-picture for the macroblock when ail the mode flags 
20 sent from the de-framing section with respect to the six DCT coefficient blocks indicate the dynamic mode. On the other 
hand, when the flag indicating the dynamic mode can be detected only in one of the six DCT coefficient blocks, the l/P 
discriminating and determining section 28 uses a P-picture for the macroblock 

[0141] If the flag of the dynamic mode is added to four or more DCT coefficient blocks of the six DCT coefficient 
blocks, an l-picture may be used for the macroblock. Also, when the flag indicating the static mode is added to all the 
25 six DCT coefficient blocks, a P-picture may be used for the macroblock. 

[01421 The DCT coefficients on the macroblock basis determined as an l/P-picture by the l/P discriminating and deter- 
mining section 28 are supplied to the coding section 9. 

[0143] The coding section 9 has a weighting (W) section 18, a quantizing (Q) section 19. an inverse quantizing (IQ) 
section 26, an inverse weighting (IW) section 25, a FM section 24, a variable-length coding (VLC) section 20, a buffer 
30 memory 23. and a rate control section 29. 

[01 44] The weighting (W) section 1 8 carries out weighting on the DCT coefficient as the conversion output supplied 
from the converting section 16 through the discriminating section 7. 

[0145] The quantizing (Q) section 19 quantizes the DCT coefficient weighted by the weighting (W) section 18. Then, 
the variable-length coding (VLC) section 20 carries out variable-length coding of the DCT coefficient quantized by the 
as quantizing section 19 and supplies MPEG coded data to the buffer memory 23. 

[0146] The buffer memory 23 fixes the transfer rate of the MPEG coded data and outputs the MPEG coded data as 
a bit stream The rate control section 29 controls increase and decrease in the quantity of generated information of the 
quantizing (Q) section 19. that is. the quantization step, in accordance with change information such as increase and 
decrease in the buffer capacity of the buffer memory 23. 
40 [0147] The inverse quantizing (IQ) section 26 inversely quantizes the quantized DCT coefficient from the quantizing 
(Q) section 19 and supplies the inversely quantized DCT coefficient to the inverse weighting (IW) section 25. The 
inverse weighting (IW) section 25 carries out inverse weighting, which is reverse operation of weighting, on the DCT 
coefficient from the inverse quantizing (IQ) section 26. The DCT coefficient processed by inverse weighting by the 
inverse weighting (IW) section 25 is stored in the FM section 24 as a reference DCT coefficient. 
as [0148] As described above, in the digital video signal conversion device shown in Fig. 13, the discriminating section 7 
discriminates an l-picture or a P-picture for each macroblock by using the l/P discriminating and determining section 28 
in accordance with the mode flag indicating the dynamic mode/static mode sent from the de-framing section 1 1 . There- 
fore the DV signal originally consisting of an l-picture alone can be converted to an MPEG picture using an l-picture or 
a P-picture. and such an advantage as improvement in the compression rate as a feature of the MPEG video signal can 



be utilized. , 
[0149] A digital signal conversion method and device according to a sixth embodiment of the present invention will 

now be described. , 
[0150] The digital video signal conversion device according to the sixth embodiment is a digital video signal conver- 
sion device in which the discriminating section 7 shown in Fig. 13 is replaced by a discriminating section 30 shown in 

[0151] Specifically, the digital video signal conversion device has a decoding section 8 for carrying out partial decod- 
ing processing on the DV signal and obtaining a signal of the orthogonal transform domain such as a DCT coefficient, 
a converting section 16 for carrying out signal conversion processing for format conversion with respect to the DCT 
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coefficient from the decoding section 8, a discriminating section 30 for discriminating whether or not to carry °utforward 
inter-frame differential coding for each predetermined block unit of the conversion output from the converting section 16 
in accordance with the maximum value of the absolute value of the inter-frame difference of the conversion output, and 
a coding section 9 for coding the conversion output from the converting section 16 on the basis of the result of d.scr.m- 
5 ination from the discriminating section 30 and outputting the MPEG video signal. 

101521 The discriminating section 30 refers to the maximum value of the absolute value of an AC coefficient at the 
time when the difference between the converted DCT coefficient as the conversion output from the converting section 
16 and a reference DCT coefficient from a FM section 24 is taken, and compares this maximum value with a predeter- 
mined threshold value. The discriminating section 30 allocates a l/P-picture to each macroblock on the basis of the 

io result of comparison. . . .-^...^m 

[0153] The discriminating section 30 has a difference calculating secton 31, a maximum value detecting section 32, 
a comparing section 33, and an l/P determining section 35. 

[01 54] The difference calculating section 31 calculates the difference between the converted DCT coefficient from the 
converting section 16 and the reference DCT coefficient from the FM section 24. The differential output from the differ- 
is ence calculating section 31 is supplied to the maximum value detecting section 32 and is also supplied to the l/P deter- 

raiS ^^em^ximum value detecting section 32 detects the maximum value of the absolute value of the * AC coeffi- 
cient of the differential output. Basically, when a large quantity of information is converted to DCT coeffiaents. the AC 
coefficient becomes large. On the other hand, when a small quantity of information is converted to DCT coefficients, the 

20 AC coefficient becomes small. 

[0156] The comparing section 33 compares the maximum value of the absolute value from the maximum value 
detecting section 32 with a predetermined threshold value supplied from a terminal 34. As this predetermined threshold 
value is appropriately selected, the quantity of information converted to the DCT coefficients can be discriminated in 
accordance with the maximum value of the absolute value of the AC coefficient. 

25 [01 57] The l/P determining section 35 discriminates whether the difference of the DCT coefficients from the difference 
calculating section 31 . that is. the difference in the information quantity, is large or small by using the result of compar- 
ison from the comparing section 33. When it is discriminated that the difference is large, the l/P determining section 35 
allocates an l-picture to a macroblock consisting of the converted DCT coefficient block from the converting section 1 6. 
When it is discriminated that the difference is small, the l/P determining section 35 allocates a P-picture to a macroblock 

30 from the difference calculating section 31. . 4 . . . . . . . 4 . a# 

[01 58] That is if the absolute value of the maximum value is greater than the threshold value, it is discriminated that 
the information quantity of the difference is large and an l-picture is employed as the macroblock. On the other hand, if 
the absolute value of the maximum value is smaller than the threshold value, it is discriminated that the information 
quantity of the difference is small and a P-picture is employed as the macroblock. 

35 [01 59] Thus the digital video signal conversion device according to the sixth embodiment is capable of converting a 
DV signal originally consisting of an l-picture to an MPEG picture using an l-picture or a P-picture, and can utilize the 
advantage of improvement in the compression rate as a feature of MPEG signal video signals. 
[0160] In the digital video signal conversion device shown in Figs. 13 and 14, a DV signal and an MPEG1 video signal 
in conformity to the NTSC system are used as the input and output, respectively. However, this digital video signal con- 

40 version device can also be applied to each signal of the PAL system. 

[01 61 ] The above-described resolution conversion processing can be similarly applied to conversion from the DV for- 
mat to the MPEG2 format. 

[01 62] As the resolution conversion processing carried out by the converting section 1 6. resolution conversion for con- 
traction is mainly described above. However, enlargement is also possible. Specifically, in general, the resolution can 
45 be enlarged at an arbitrary magnification by adding a high-frequency component to an input digital signal of the fre- 
quency domain. 

[01 63] When an MPEG2 video signal is applied to a digital broadcasting service, the signal is classified in accordance 
with the profile (function)/Ievel (resolution). Enlargement of the resolution can be applied to. for example, the case 
where a video signal of the main profile/high level (MP@HL) used for a digital HDTV in the United States is converted 
so to the DV signal. 

[0164] The processing of the sixth embodiment may also be carried out by software means. 

[01 65] A digital signal conversion method and device according to a seventh embodiment of the present invention will 
now be described with reference to Fig. 15. The same parts of the structure as those of the above-described embodi- 
ment are denoted by the same reference numerals. 
55 [0166] A rate control section 40 controls the data quantity in a quantizing section 19 on the basis of a quantizer 
number (Q_NO) and a class number (Class) from a de-framing section 11. 

[0167] Fig.1 6 shows the basic procedure for setting the quantizer scale for each macroblock (MB) of each frame in 
converting a DV video signal to an MPEG video signal by the digital signal conversion method of the seventh embodi- 
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ment. 

[0168] First, at step S1. a quantizer number (Q_NO) and a class number (Class) are obtained for each macroblock. 
This quantizer number (Q_NO) is expressed by a value of 0 to 15 and is common to all the six DCT blocks in the mac- 
roblock. The class number (Class) is expressed by a value of 0 to 3 and is provided for each of the six DCT blocks. 
5 [01 69] Next, at step S2, a quantization parameter (q_param) is calculated for each DCT block in accordance with the 
following procedure. 

Quantization table q_table[4] = {9, 6, 3, 0} 

7o Quantization parameter q_param = Q_NO + q_table[class] 

[0170] Specifically, the quantization table has four kinds of values (9, 6, 3, 0), which correspond to the class numbers 
0, 1,2, 3. respectively. For example, when the class number is 2 and the quantizer number 8, the quantization table 
value 3 corresponding to the class number 2 and the quantizer number 8 are added to produce a quantization param- 
is eter of 1 1 . 

[0171] Next, at step S3, the average of the quantization parameters (q_param) of the six DCT blocks in the macrob- 
lock is calculated. 

[0172] Then, at step S4, the quantizer scale (quantizer__scale) of the MPEG macroblock is found in accordance with 
the following procedure, and the processing ends. 

20 

Quantization table q_table[25] = {32. 16, 16, 16. 16. 8, 8, 8, 8, 4, 4, 4, 2. 2, 2, 2, 2, 2. 2, 2, 2, 2, 2, 2} 

quantizer_scale = q_table[q_param] 

25 [0173] Specifically, the quantization table has 25 kinds of values (32 to 2), which correspond to the quantization 
parameters calculated in the above-described manner. The quantization table corresponding to the quantization param- 
eter value of 0 is 32. The quantization table corresponding to the quantization parameter value of 1 is 16. The quanti- 
zation table corresponding to the quantization parameter value of 5 is 8. For example, when the average value of the 
quantization parameters found in the above-described manner is 10, the value of 4 corresponding to the quantization 

30 parameter value of 10 becomes the quantizer scale value. Through this procedure, the MPEG quantizer scale 
(quantizer_scale) depending on the target rate is calculated on the basis of the quantization parameter (q_param) for 
each macroblock within each frame. The corresponding relation between the class number and the quantization table 
and the relation between the quantization parameter and the quantizer scale are experientially found. 
[0174] In the digital signal conversion device of the present invention shown in Fig. 15, the above-described process- 

35 ing is carried out by the rate control section 40 on the basis of the quantization number (Q_NO) and the class number 
(Class) sent from the de-framing section 1 1 . 

[0175] Fig. 1 7 shows the basic procedure for applying feedback to the next frame by using the quantizer scale set in 
accordance with the above-described procedure. 

[01 76] First, at step S1 1 . the number of target bits per frame at the bit rate set in accordance with the above-described 
40 procedure is set. 

[01 77] Next, at step S1 2. the total number of generated bits per frame is integrated. 

[0178] Next, at step S1 3, the difference (diff) between the number of target bits and the total number of generated bits 
is calculated. 

[0179] Then, at step S14. the quantizer scale is adjusted on the basis of the result of calculation. 
45 [0180] The calculation at each step is expressed as follows. 

diff = cont * drff (cont: constant) 

q_param = q_param ± f(diff) 

50 

quantizer_scale = q_table[q_param] 

[0181] Specifically, normalization is carried out by multiplying the differential value diff found at step S13 by the con- 
stant cont. The normalized differential value is multiplied by an experientially found function and added to or subtracted 
ss from the quantization parameter. The resultant value is used as the quantization parameter. The value corresponding 
to this quantization parameter value is selected from the quantization table having 25 kinds of values and is used as the 
quantizer scale for the next frame. 

[0182] Through the foregoing procedure, feedback between frames is carried out by calculating the new quantizer 
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scale (quantjzer.scale) on the basis of the adjusted quantization parameter (q_param) and using the new quantizer 
scale for the next frame. 

[01831 A digital signal conversion method and a digital signal conversion device according to an eighth embodiment 
of the present invention will now be described. Although the DV format is converted to the MPEG format in the forego.ng 
embodiments, the MPEG format is converted to the DV format in the following embodiment. 

[0184] With reference to Fig. 18, a conventional device for converting the MPEG format to the DV format will be 



[01851 The digital video signal conversion device shown in Fig.18 is constituted by an MPEG decoder 70 for decod.ng 
MPEG2 video data and a DV encoder 80 for outputting DV video data. 

[01881 In the MPEG decoder 70. a parser 71 , which is supplied with a bit stream ol the MPEG2 video data, detects 
the header of a bit stream of a quantized DCT coefficient framed in accordance with the MPEG2 format and supplies 
the quantized DCT coefficient coded by variable-lenglh coding to a variable-length decoding (VLD) section 72. Also, the 
parser 71 extracts a motion vector (mv) and supplies the extracted motion vector to a motion compensation (MC) sec- 

[0187] The variable-lenglh decoding (VLD) section 72 carries out variable-length decoding of the quantized DCT coef- 
ficient coded by variable-length coding and supplies the variable-length decoding result to an inverse quantizing (IQ) 
section 73 

[01 881 The inverse quantizing section 73 carries out inverse quantization by multiplying the quantized DCT coefficient 
decoded by the variable-length decoding section 72 by the quantization step used on the coding side. Thus, the inverse 
quantizing section 73 obtains the DCT coefficient and supplies the DCT coefficient to an inverse discrete cosine trans- 
form (IDCT) section 74. 

[01 89] The inverse discrete cosine transform section 74 performs inverse DCT on the DCT coefficient from the inverse 
quantizing section 73, thus restoring the DCT coefficient to data of the spatial domain, that is, pixel data. Speafically 
by inverse DCT pixel values (luminance Y and color difference Cr, Cb) are calculated for each block consisting of 8x8 
pixels. In the case of an l-picture, the pixel value is the actual pixel value itself. However, in the case of a P-picture and 
a B-picture the pixel value is the differential value between the corresponding pixel values. 

[0190] The motion compensation section 77 generates a motion compensation output by using picture information 
stored in two frame memories FM of a frame memory (FM) section 76 and the motion vector mv extracted by the parser 
71 and supplies this motion compensation output to an adder 75. 

[0191] The adder 75 adds the motion compensation output to the differential value from the inverse discrete cosine 
transform section 74 and supplies decoded picture data to a discrete cosine transform (DCT) section 81 of the DV 
encoder 80 and the frame memory section 76. 

[0192] In the DV encoder 80, the discrete cosine transform section 81 performs DCT processing on the decoded pic- 
ture data to again convert the decoded picture data to the data of the orthogonal transform domain, that is, the DCT 
coefficient, and supplies the DCT coefficient to a quantizing (Q) section 82. 

[0193] The quantizing section 82 quantizes the DCT coefficient by using a matrix table in consideration of the visual 
characteristics and supplies the quantization result as an l-picture of the DV format to a variable-length coding (VLC) 

section 83. , . , 

[01 94] The variable-length coding section 83 compresses the l-picture of the DV format by carrying out variable-length 

coding processing and supplies the compressed l-picture to a framing section 84. 

[0195] The framing section 84 frames the DV format data on which variable-length coding processing is performed 
and outputs a bit stream of the DV video data. 

[0196] Meanwhile, orthogonal transform such as discrete cosine transform (DCT) and inverse transform thereof gen- 
erally require a large quantity of calculation and therefore raise a problem that format conversion of video data as 
described above cannot be carried out efficiently. Since errors are accumulated along with the increase in the calcula- 
tion quantity, there is also a problem that the signal is deteriorated. 

[01 97] Thus, a digital video signal conversion device according to the eighth embodiment to solve these problems will 
be described with reference to Fig. 19. ^ 

[01 98] In the digital signal conversion device shown in Fig. 1 9, an MPEG video signal in conformity to the MPEG for- 
mat as described above is inputted as a first digital signal, and a DV signal is outputted as a second digital signal. 
[0199] A parser 1 1 1 extracts motion information of the image such as the motion vector mv and the quantizer scale 
with reference to the header of the MPEG video signal as the digital signal of the f irst format. 

[0200] The motion vector mv is sent to a motion compensation (MC) section 1 1 5, where motion compensation is car- 
ried out. The quantizer scale (quantizer_scale) is sent to an evaluating section 123. which will be described later. 
[0201] A variable-length decoding (VLD) section 1 12 carries out variable-length decoding on the bit stream of the 
MPEG video signal from which necessary information is extracted by the parser 111. 

[0202] An inverse quantizing (IQ) section 1 1 3 inversely quantizes the MPEG video signal decoded by the variable- 
length decoding section 112. 
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[0203] Then, the MPEG video signal inversely quantized by the inverse quantizing section 1 1 3 is inputted to an adder 
125. To this adder 125, the result of motion compensation for the motion vector mv from the parser 1 1 1 is also inputted 
from the motion compensation section 1 1 5. 

[0204] The output from the adder 125 is sent to a signal converting section 116, which will be described later, and is 
5 also inputted to the motion compensation section 1 15 through a frame memory 114. The signal converting section 116 
performs required signal conversion processing such as resolution conversion in the orthogonal transform domain (fre- 
quency domain) on the video signal inputted through the adder 125. 

[0205] The video signal on which required signal conversion processing is performed by the signal converting section 
1 16 is shuffled by a shuffling section 117 and is then sent to a buffer 1 18 and a classifying section 122. 

to [0206] The video signal sent to the buffer 1 1 8 is sent to a quantizing (Q) section 1 19 and is quantized by this quan- 
tizing section 119. Then, the video signal is variable-length coded by a variable-length coding (VLC) section 120. In 
addition, the video signal is framed by a framing section 121 and outputted as a bit stream of the DV video signal. 
[0207] On the other hand, the classifying section 1 22 classifies the video signal shuffled by the shuffling section 1 1 7 
and sends the result of classification as class information to the evaluating section 123. 

is [0208] The evaluating section 1 23 determines the quantization number at the quantizing section 1 1 9 on the basis of 
the class information from the classifying section 122 and the quantizer scale (quantizer_scale) from the parser 111. 
[0209] With such a structure, since the data quantity of the DV video signal outputted as the video signal of the second 
format can be determined on the basis of the data quantity information included in the MPEG video signal inputted as 
the video signal of the first format, processing for determining the data quantity of the video signal of the second format 

20 generated by signal conversion can be simplified. 

[021 0] The above-described seventh and eighth embodiments can also be applied to the case where one of the digital 
signal of the first format and the digital signal of the second format is an MPEG1 video signal while the other is an 
MPEG2 video signal. 

[021 1] A digital signal conversion method and a digital signal conversion device according to a ninth embodiment of 

25 the present invention will now be described with reference to Fig. 20. 

[0212] The digital signal conversion device is a device for converting MPEG video data conforming to the MPEG2 
format to DV video data conforming to the DV format. It is assumed that these data are data of the PAL system. 
[021 3] In the case where the video signal is a signal of the PAL system, the signals conforming to the MPEG2 format 
and the DV format have a resolution of 720x576 pixels and a ratio of the sampling frequency of a luminance signal to 

30 the sampling frequencies of two color-difference signals equal to 4:2:0. Therefore, resolution conversion processing 
need not be carried out with respect to either the Y signal or the C signal. 

[0214] In Fig. 20, an MPEG decoder 100 has a parser 1 1 1 , a variable-length decoding (VLD) section 1 12, an inverse 
quantizing (IQ) section 1 13, an adder 125, an inverse discrete cosine transform (IDCT) section 131, a frame memory 
(FM) section 132, a motion compensation (MC) section 1 15, and a discrete cosine transform (DCT) section 130. The 

35 frame memory (FM) section 132 is so constituted as to be used as two predictive memories. 

[0215] As will be later described in detail, the inverse discrete cosine transform section 131 carries out inverse dis- 
crete cosine transform processing on an l-picture and a P-picture partially decoded by the variable-length decoding 
section 1 12 and the inverse quantizing section 113. The motion compensation section 115 generates a motion com- 
pensation output on the basis of the inverse discrete cosine transform output. The discrete cosine transform section 1 30 

40 carries out discrete cosine transform on the motion compensation output. The adder 125 adds the motion compensa- 
tion output from the discrete cosine transform section 130 to a P-picture and a B-picture partially decoded by the vari- 
able-length decoding section 112 and the inverse quantizing section 1 13. 

[021 6] The overall operation will be described hereinafter. First, the parser 1 1 1 restores the quantized DCT coefficient 
framed in conformity to the MPEG2 format to a variable-length code with reference to the header of the MPEG2 video 
45 data inputted as a bit stream, and supplies the variable-length code to the variable-length decoding section 112. Also, 
the parser 1 1 1 extracts the motion vector (mv) and supplies the extracted motion vector to the motion compensation 
section 1 1 5. 

[021 7] The variable-length decoding section 1 1 2 carries out variable-length decoding of the quantized DCT coefficient 
restored to the variable-length code, and supplies the variable-length decoding result to the inverse quantizing section 

50 113. 

[0218] The inverse quantizing section 113 carries out inverse quantization processing by multiplying the quantized 
DCT coefficient decoded by the variable-length decoding section 1 12 by the quantization step used on the coding side. 
The inverse quantizing section 1 1 3 thus obtains the DCT coefficient and supplies the DCT coefficient to the adder 1 25. 
The DCT coefficient obtained by the variable-length decoding section 112 and the inverse quantizing section 1 13 is 
55 supplied to the adder 1 25 as an output which will not be restored to pixel data by inverse discrete cosine transform, that 
is, as partially decoded data. 

[0219] The adder 125 is also supplied with the motion compensation output from the motion compensation section 
115, which is orthogonally transformed by the discrete cosine transform section 130. Then, the adder 125 adds the 
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motion compensation output to the partially decoded data in the orthogonal transform domain. The adder 125 supplies 
the addition output to a DV encoder 1 10 and also to the inverse discrete cosine transform section 131 . 
[02201 The inverse discrete cosine transform section 131 performs inverse discrete cosine transform processing on 
an l-picture or a P-picture within the addition output, thus generating data of the spatial domain. This data of the spatial 
domain is reference picture data used for motion compensation. The reference picture data for motion compensation is 
stored in the frame memory section 132. 

[0221 ] The motion compensation section 1 1 5 generates the motion compensation output by using the reference pic- 
ture data stored in the frame memory section 1 32 and the motion vector mv extracted by the parser 1 1 1 , and supplies 
the motion compensation output to the discrete cosine transform section 130. 

[0222] The discrete cosine transform section 130 restores the motion compensation output processed in the spatial 
domain to the orthogonal transform domain as described above and then supplies the motion compensation output to 

[0^3] de The adder 1 25 adds the DCT coefficient of the motion compensation output from the discrete cosine transform 
section 1 30 to the DCT coefficient of the differential signal of the partially decoded P- and B-pictures from the inverse 
quantizing section 1 1 3. Then, the addition output from the adder 1 25 is supplied as partially decoded data in the orthog- 
onal transform domain to the DV encoder 1 10 and the inverse discrete cosine transform section 131 . 
[0224] Since the partially decoded l-picture from the inverse quantizing section 1 13 is an intra-frame coded image 
signal, motion compensation addition processing is not necessary. The partially decoded l-picture is supplied as it is to 
the inverse discrete cosine transform section 131 and is also supplied to the DV encoder 1 10. 
[0225] The DV encoder 1 10 includes a quantizing (Q) section 141 , a variable-length coding (VLC) section 142. and a 
framing section 143. . 
[0226] The quantizing section 141 quantizes the decoded output, that is. the DCT coefficient, of the i-picture, P-pic- 
ture and B-picture in the orthogonal transform domain from the MPEG decoder 100. and supplies the quantized DCT 
coefficient to the variable-length coding section 1 42. 

[0227] The variable-length coding section 142 carries out variable-length coding processing of the quantized DCT 
coefficient and supplies the coded data to the framing section 143. The framing section 143 frames the compression- 
coded data from the variable-length coding section 142 and outputs a bit stream of DV video data. 
[0228] In this manner, when the MPEG2 video data to be converted is an l-picture. the MPEG decoder 100 causes 
the variable-length decoding section 1 12 and the inverse quantizing section 1 13 to partially decode the MPEG2 video 
data to the orthogonal transform domain, and the DV encoder 110 causes the quantizing section 141 and the variable- 
length coding section 1 42 to partially code the video data. At the same time, the MPEG decoder 1 00 causes the inverse 
discrete cosine transform section 1 31 to perform inverse discrete cosine transform on the l-picture and stores the result- 
ant l-picture into the frame memory section 132 as a reference picture for the P/B-picture. 

[0229] On the other hand, when the MPEG2 video data to be converted is a P-picture or a B-picture. only the process- 
ing for generating the motion compensation output is carried out in the spatial domain by using the inverse discrete 
cosine transform section 131. and the processing for constituting the frame in addition to the differential signal as the 
P-picture or B-picture partially decoded by the variable-length decoding section 1 12 and the inverse quantizing section 
113 is carried out in the discrete cosine transform domain by using the discrete cosine transform section 130, as 
described above. After that, partial encoding is carried out by the DV encoder 110. 

[0230] Particularly, in the case of the P-picture. a macroblock at a position indicated by the motion vector mv is taken 
out from the l-picture processed by inverse discrete cosine transform by the inverse discrete cosine transform section 
1 31 by motion compensation processing by the motion compensation section 1 1 5. Discrete cosine transform process- 
ing is performed on the macroblock by the discrete cosine transform section 1 30 and is added to the DCT coefficient of 
the P-picture as a differential signal in the discrete cosine transform domain by the adder 125. This processing is based 
on that the result of discrete cosine transform performed on the addition result in the spatial domain is equivalent to the 
result of addition of data processed by discrete cosine transform. This result is partially encoded by the DV encoder 
110 At the same time, as a reference for the next B-picture, inverse discrete cosine transform is performed on the addi- 
tion output from the adder 125 by the inverse discrete cosine transform section 131 and the resultant data is stored in 
the frame memory section 132. 

[0231 ] In the case of the B-picture. a macroblock at a position indicated by the motion vector mv is taken out from the 
P-picture which is processed by inverse discrete cosine transform by the inverse discrete cosine transform section 131 . 
Then discrete cosine transform is carried out on the macroblock by the discrete cosine transform section 130. and the 
DCT coefficient of the B-picture as a differential signal is added thereto in the discrete cosine transform domain. In the 
bidirectional case, macroblocks from two reference frames are taken out and the average thereof is used. 
[0232] The result is partially encoded by the DV encoder 110. Since the B-picture does not become a reference frame, 
inverse discrete cosine transform need not be carried out by the inverse discrete cosine transform section 131 . 
[0233] While both inverse discrete cosine transform (IDCT) and discrete cosine transform (DCT) processing are con- 
ventionally required to decode an l-picture. the digital video signal conversion device according to the above-described 
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ninth embodiment only requires IDCT for reference. . u^nrT^nd 

,0234] To decode a P-picture, OCT and IDCT processing for reference are necessary. Ho^.^ftD CT and 
IdcT are conventionally required to decode a B-picture. the digital video signal converse dev.ce according to the 

mT^T^Xl^^ "avfnglhe number of GOPs N =15 and the forward predict picture spac- 
naM^on?^ 

S OCT and t^^ lDCT ar^substantially equal, when weighting is omitted, the MPEG2 data per 15 frames .s 
expressed by 

2xDCTx(1/15) +2xDCT(4/15) +2xDCTx(10/15) = 2xDCT 

in the case of the conventional technique, and is expressed by 

1xDCTx(1/15) + 2xDCTx(4/15) + 1 xDCTx(10/15) = 1.2666xDCT 

in the case of the digital video signal conversion device shown in F.g.20. Thus, the calculation quantity can be signifi- 
es ntiv reduced DCT in these equations represents the calculation quantity. 

for format conversion from MPEG2 video data to DV video data can be significantly reduced. 

5Sl AdK video signal conversion device according to a tenth embodiment of the present invention will now be 

^ h tLtSS£2S. too. a digHal video signal conversion device for converjg MPEG v«ec > data con- 
forming to the MPEG2 format to DV video data conforming to the DV format .s employed. However, it .s assumed that 
the MPEG2 video data is a compressed video signal of a high resolution, for example. 1440x1080 p.xels. 
0239] For example, when an MPEG2 video signal is applied to a digital broadcasting service the signa £ dashed 
in accomance wiZhe profile (f unctJon)/leve. (resolution). A video signal of the main prof.leAt.gh level (MP@HL) used 
for a digital HDTV in the United States has a high resolution, as described above, and th.s signal .s converted to the DV 

S] dat Therefore, the digital video signal conversion device shown in Fig.21 has such a strucfore that a signal con- 
verting section 140 for carrying out the above^iescribed conversion processing is provided between the MPEG decoder 

1 00 and the DV encoder 1 1 0 of Fig.20. „. . . ._ a.. 

102411 This signal converting section 140 carries out resolution conversion processing on the DCT coefficient .n the 
DCT transform domain from the MPEG decoder, by using a transform matrix generated on the basis of a" '"verse 
orthogonal transform matrix corresponding to the orthogonal transform matrix used for DCT coding Performed on the 
MPEG coded data and an orthogonal transform matrix corresponding to the inverse orthogonal transform matnx used 
for IDCT coding for obtaining a signal conversion output signal in the time domain. 

[0242] The DCT coefficient as a resolution conversion output from this signal converting section 140 is supplied to 

[0243] 6 The DV encoder 1 1 0 carries out quantization and variable-length coding on the DCT coefficient as the resolu- 
tion conversion output, then frames the DCT coefficient, and outputs a bit stream of DV video data^ 
[0244] Thus in this digital video signal conversion device, the video signal of the mam prof.lerti.gh level (MP®HL) 
within the MPEG video signal is resolution-converted by the signal converting section 140 and then coded by the DV 
encoder to generate the DV video data. 

[0245] Similarly to the digital video signal conversion device of Fig.20. with respect to an l-picture. the i digital video 
signal conversion device of this tenth embodiment only requires IDCT for reference, whereas both IDCT and DCT 
processing are conventionally required. .. . ■ , A(iw , 

[0246] With respect to a P-picture. DCT and IDCT for reference are earned out as in the conventional technique With 
respect to a B-picture, this digital video signal conversion device only requires DCT and needs no IDCT. while both DCT 
and IDCT are conventionally required. 

[0247] That is in the digital video signal conversion device of Fig.21 . too. the quantity of data calculation processing 
for format conversion from MPEG2 video data of a high resolution to DV video data can be significantly reduced. 
[0248] As the resolution conversion processing earned out by the signal converting section 1 40. resolution conversion 
for contraction is mainly described. However, enlargement is also possible. Specifically, in general, the resolution can 
be enlarged at an arbitrary magnification by adding a high-frequency component to an input digital signal of the fre- 
quency domain. For example, format conversion from MPEG1 video data to the DV video data is earned out. 
10249] The above-described processing may also be carried out by means of software. 

0250] Meanwhile, in the above^iescribed compression system of the MPEG format or the DV format, a hybrid com- 
pression coding method using orthogonal transform coding in combination with predictive coding is employed in order 
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to efficiently compression-code still image data or dynamic image data. 

[0251 ] When orthogonal transform and predictive coding along with motion compensation are carried out again after 
resolution conversion processing is carried out on an input information signal which is compression-coded by the hybrid 
compression coding method, the motion vector must be estimated at the step of carrying out re-predictive coding 
processing. 

[0252] If predictive coding is carried out again with perfectly the same resolution wrthout carrying out resolution con- 
version processing, the motion vector at the time of predictive coding may be used. However, if the resolution is con- 
verted, the conversion distortion is changed. Therefore, the motion vector used at the re-predictive coding step is also 

changed. , , l _ , ... 

[0253] Thus, the motion vector needs to be estimated at the re-predictive coding step. However, the quantity of arith- 
metic processing is required for estimation of the motion vector. 

[0254] To eliminate this problem, a digital signal conversion device according to an eleventh embodiment is used. In 
the digital signal conversion method and device according to the eleventh embodiment, an input information signal 
which is compression-coded by hybrid compression coding using orthogonal transform coding in combination with pre- 
dictive coding is processed by signal conversion processing such as resolution conversion in the time domain or the 
orthogonal transform domain and then restored to the orthogonal transform domain for re-compression coding, or com- 
pression-coded in the orthogonal transform domain. 

[0255] The above-described hybrid compression coding is exemplified by H.261 and H.263 recommended by ITU-T 
(International Telecommunication Union - Telecommunication Standardization Section), and MPEG and DV coding 
standards. 

[0256] The H.261 standard is an image coding standard for a low bit rate and is developed mainly for teleconference 
and video phone through ISDN. The H.263 standard is an improved version of H.261 for the GSTN video phone system. 
[0257] The eleventh embodiment will now be described with reference to Fig.22. In the digital video signal conversion 
device of the eleventh embodiment. MPEG coded data conforming to the MPEG format is inputted and processed by 
resolution conversion processing as signal conversion processing, and the resolution-converted MPEG coded data is 
outputted. 

[0258] This digital video signal conversion device has a decoding section 21 0 for carrying out decoding using motion 
compensation MC with respect to a bit stream of MPEG coded data which is compression-coded along with motion vec- 
tor (mv) detection, a resolution converting section 160 for performing resolution conversion processing on the decoding 
output from the decoding section 210. and a coding section 220 for performing compression coding processing along 
with motion detection based on the motion vector mv added to the MPEG coded data, on the conversion output image 
from the resolution converting section 160. and outputting a bit stream of video coded data which is resolution-con- 
verted, as shown in Fig.22. 

[0259] The digital video signal conversion device constituted by these parts will be described hereinafter. It is a matter 
of course that each constituent part carries out processing of each step of the digital signal conversion method accord- 
ing to the present invention. 

[0260] The decoding section 21 0 includes a variable-length decoding (VLD) section 1 1 2, an inverse quantizing (IQ) 
section 1 1 3, an inverse discrete cosine transform (IDCT) section 1 50. an adder 1 51 . a motion compensation (MC) sec- 
tion 152, and a frame memory (FM) section 153. The FM section 153 is constituted by two frame memories FM used 
as predictive memories. 

[0261 ] The VLD section 1 12 decodes the MPEG coded data, that is. coded data obtained by variable-length coding 
of the motion vector and the quantized DCT coefficient as additional information, in accordance with variable-length 
coding, and extracts the motion vector mv. The IQ section 1 1 3 carries out inverse quantization processing by multiplying 
the quantized DCT coefficient decoded by the VLD section 1 12 by the quantization step used on the coding side, thus 
obtaining the DCT coefficient. 

[0262] The IDCT section 150 performs inverse DCT on the DCT coefficient from the IQ section 1 13. thus restoring 
the DCT coefficient to data of the spatial domain, that is. pixel data. Specifically, by inverse DCT. the respective pixel 
values (luminance Y and color-difference Cr. Cb) are calculated for each block consisting of 8x8 pixels. In the case of 
an l-picture. the pixel value is the actual pixel value itself. However, in the case of a P-picture and a B-picture. the pixel 
value is the differential value between the corresponding pixel values. 

[0263] The MC section 152 performs motion compensation processing on the image information stored in the two 
frame memories of the FM section 153 by using the motion vector mv extracted by the VLD section 1 12, and supplies 
the motion compensation output to the adder 151. 

[0264] The adder 151 adds the motion compensation output from the MC section 152 to the differential value from 
the IDCT section 150, thus outputting a decoded image signal. The resolution converting section 160 carries out 
required resolution conversion processing on the decoded image signal. The conversion output from the resolution con- 
verting section 1 60 is supplied to the coding section 220. 

[0265] The coding section 220 includes a scale converting section 171. a motion estimation (ME) section 172. an 
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SSfil reioSco^rS, rate used by the resolution converting section 160 is 1/2. the motion vector mv ,s con- 

r£!S t0 S, e e Miction 172 searches an arrow range of the conversion output from the resolution converting section 
Z fS us^ng STS^SSSian from the scale converting section 171 . thus estimating me optimum motion 

S - SSESSl£l^ by the ME section 1 72 is used at the time of motion compensation carried out by 
!ne MC S T^e conversion oulput image from the resolution converting section 1 60 used for estimation of the 

!n c0 « characteristics. The VLC section 177 compresses thequantized DOT coeff -cent from me 

S^lJJtSS^^^ for maintaining a constant transferrate of the coded data which is 

Son iS tSt is the quantization step, in accordance with the change information about the mcrease/decrease ,n 
SyrSSSS: SSSElSo- decoding secton together with the .OCT section 1 80. The .Q section 

3s ^fSS3S?tSw information stored in the FM section 182 is processed by motion compensation by the 

m 7 T ™l ? MC section 174 carries out motion compensation on the image information stored in the >FM section ,182 
by using the optimum motion vector estimated by the ME section 1 72. and supplies the motion compensation oulput as 

«, ^T^^^cSSS.. difference between the conversion oufcut picture from the resolution, overling 
ecton l2 and the reference picture, and supplies the difference to the DOT section iTJ as descnbed ^ove , 
rS The DCT section 175, the Q section 176, the VLC section 177 and the buffer memory 178 operate as 
deSLd 2ove. UltS the reso.ution-converted video coded data is outputted as a bit stream at a constant trans- 
ferrate from this digital video signal conversion device. „-,:„„ -,-n rrfthp 

,s [02791 In this digital video signal conversion device, when the motion vector « estimated by the ME section 172 of *e 
Eg section 220. the motion vector appended to the macroblock of the origina. compressed vdeo ^hs «™erted 
in scale by the scale converting section 1 71 in accordance with the resolut,on convers-on rate ,n the resolute*, oonvert- 
na 160 and the narrow range of the conversion output picture from the resolution converting sect on 160 .s 

S.r<Sd on me oasis of the scale conversion information from the scale converting section 171 so as to estimate me 
so mot on vecto, for motion compensation, instead of estimating me motion vector in me absence of any '^^at^Thu^ 
Snce the calculation quantity in the ME section 172 can be significantly reduced, rr^atunzation of the dev,ce and 

rc^re^SeS 

for performing resolution conversion processing on an MPEG video signal and outputt-ng a resolution-converted vrieo 

" £l]' S ^Sal video agna. convers.on device has a decoding section 211 for obtafoing decoded data of me 
ormogonal transform domain by carrving out only predictive decoding process.ng ^ respect to MPEG 

coded data on which the above-described hybrid coding is performed, a resolution converting section 260 for perform 
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ing resolution conversion processing on the decoded data of the orthogonal transform domain from the decoding sec- 
tion Si and a coding section 221 for performing compression coding processing a.ong wrth motion. =ompensa on 
paction on the conversion output from the resolution converting section 260 by us.ng motion detection based on 
motion vector information of the MPEG coded data, as shown in F.g.23. 

[0282] The digital video signal conversion device constituted by these parts will be described hereinafter a i matter 
of course that each constituent part carries out processing of each step of the digital s.gnal conversion method accord- 

55T in thSSsigna. conversion device, conpared with the device shown in Fig.22 the .OCT section 150 
is not necessary in the decoding section 210. and the OCT section 175 and the IDCT sect.cn 180 are not "ecessa^jn 
the coding section 220. That is. in this digital video signal conversion device, resolution conversion processing earned 
out on the decoded data of the DCT domain and the conversion output thereof is coded. 

SJmi Orthogonal transform such as DCT and inverse orthogonal transform generally require a large calculation 
quantity. Therefore, resolution conversion as described above may not be earned out efficiently. Also, since enors are 
accumulated along with the increase in the calculation quantity, the signal might be deteriorated. 
[02851 ™us. in the digital video signal conversion device of Fig.23. the IDCT section 150. the DCT section 1 74 and 
he IDCT section 180 of Fig.22 are eliminated and the function of the resolution converting section 160 is changed. 
[0286] Also, in order to calculate activity which will be later described from the conversion DCT «>^i«errt from the 
resolution converting section 160 in the DCT domain and estimate the motion vector by using the activity, an activity 
calculatina section 200 is used in place of the scale converting section 171 of Fig.22. 

ST TheTesolution converting section 260 shown in Fig.23 is supplied wKh an addition output (DC T«taJ 
which is obtained by an adder 251 by adding a motion compensation output from an MC section 252 to a DCT coeffi- 
cient obtained by an IQ section 213 by inversely quantizing a quantized DCT coefficient decoded by a^«rton2l 2 
[0288] This resolution converting section 260 carries out resolution conversion processing on the DCT coefficient of 
the DCT transform domain from the decoding section 211. by using a transform matrix generated on the basis of an 
inverse orthogonal transform matrix corresponding to the orthogonal transform matrix used for DCT coding pe*"™* 
on the MPEG coded data and an orthogonal transform matrix corresponding to the inverse orthogonal transform matrix 
used for IDCT coding for obtaining a signal conversion output signal in the time domain. 

r02891 The DCT coefficient as the resolution conversion output from the resolution converting section 260 is suppled 
o the activity calculating section 200. The activity calculating section 200 calculates the ^P 3 ^*^^* 
roblock from the luminance component of the DCT coefficient from the resolution converting section 260 _Specrfcal ly. 
the feature of the image is calculated by using the maximum value of the AC value of the DCT coefficient. For example, 
the existence of fewer high-frequency components indicates a flat image. 

r02901 An ME section 272 estimates the optimum motion vector at the converted resolution on the basis of the activrty 
calculated by the activity calculating section 200. Specifically, the ME section 272 converts the mot,on 
extracted by the VLD 212 on the basis of the activity calculated by the activi* casting sector .200 soasto estmate 
the motion vector mv, and supplies the estimated motion vector mv to an MC sect.cn 274 The ME section 272 est. 
mates the motion vector in the orthogonal transform domain. This motion estimation in the orthogonal transform domain 

^29T] de ^rreso!ution-converted DCT coefficient from the resolution converting section 260 is supplied to an adder 
273 through the activity calculating section 200 and the ME section 272. 

[0292] The adder 273 calculates the difference between a reference DCT coefficient which will be later described and 
the converted DCT coefficient from the resolution converting section 260, and supplies the difference to a quantizing 

[0293T'The Qsection 276 quantizes the differential value (DCT coefficient) and supplies the quantized DCT coefficient 
to a VLC section 277 and an IQ section 279. _ ^ 

[0294] A rate control section 283 controls the increase/decrease in the quantity of generated information in the U sec- 
tion 276 that is the quantization step, in accordance with the activity information from the activity calculating section 
200 and'the change information about the increase/decrease in the buffer capacity of a buffer memory 278. 
[0295] The VLC section 277 compression-codes the quantized DCT coefficient from the Q section 276 by using var- 
iable-length coding and supplies the compressed DCT coefficient to the buffer memory 278. The buffer memory ,278 
maintains a constant transfer rate of the coded data which is compressed by variable-length coding by the VLC section 
277 and outputs the resolution-converted video coded data as a bit stream at a constant transfer rate. 
[0296] The IQ section 279 inversely quantizes the quantized DCT coefficient from the Q section 276 and s"PP»e s •» 
DCT coefficient to the adder 281. The adder 281 adds the motion compensation output from the MC section 274 to the 
DCT coefficient as the inverse quantization output from the IQ section 279. The DCT coefficient information as the addi- 
tion output from the adder 281 is supplied to the FM section 282. The DCT coefficient information stored in the FM sec- 
tion 282 is processed by motion compensation by the MC section 274. 

[0297] The MC section 274 carries out motion compensation on the DCT coefficient information stored in the FM sec- 
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tion 282 by using the optimum motion vector estimated by the ME section 272, and supplies the motion compensation 

n.rtnut as a reference DCT coefficient to the adder 281 . 

m?98 The adder 273 ca.cu.ates the drtference between the converted DCT coefficient tanth. re»l^on«rwertng 

l Z L^on^Z "Lo coded data is outputted at a constant transfer rate from th,s digital vdeo s.gnal conver- 

mSocte of a reference picture B. When the picture A to be compressed and the reference p,cture B are 
StoolerapS 

ddeln he case of Fig.24. a macroblock B" to be compressed now extends partially on four macroblocte B , , 
efof the relence picture B. Therefore, no macroblock of the reference picture B corresponds to the ^crobtock B 
B 4 of the reterence pww reference picture B at a position of the macroblock B cannot be obtained. 

Thus 3 itl nee l o^Z ool £££m of the reference picture B of the portion where the macroblo* £ s 
^.^^nvSnfl the DCT coefficient of the four macroblocks of the reference picture B over wh.ch the macroblock 

foS ia, F.airschematical.y shows the procedure of this conversion processing. Since the lower left part of the mac- 
SSSc B of the referee pLre B overlaps the upper right part of the macroblock B', a macroblock B 13 is generated 
Z ^Ct ScJ ^Z^ the maaoblock B, as will be later described. Similarly, since the lower right part of 
Th. ^ohlock L of the reference picture B overlaps the upper left part of the macroblock B , a macroblock B 24 .s gen- 
SS^SSSS 2 SSSLnt of the macroblock B, as will be later described. Similar processing yearned 
out S the m^blocks B 3 and B 4 . thus generating macroblocks B 31 and B 42 . By combining the ' ^ 
IZXT^ L thus generated, the DCT coefficient of the reference picture B of the portion where the macroblock B 
is located can be obtained. 

[0303] In short, this processing can be expressed by the following equations (6) and (7). 

30 B = B 13 + B 24 + B 31 + B 42 & 

DCT(B-) = DCT(B 13 ) + DCT(B 24 ) + DCT(B 31 ) + DCT(B 42 ) (7) 

35 [03041 Conversion of the DCT coefficient of the macroblock will now be described with reference tol F.g.26. Fig 26 
shows a mathematical model for finding the partial macroblock B 42 by calculation from the onginal block B 4 or the .ke 

rnT/spaiidrrspe^ 

side. That is. B 42 obtained by calculation of the following equation (8) from the block B 4 is shown. 

B 42 = H,xB 4 xH 2 < 8 > 

IT^^S* to a pre-atrix H, which is synthesized with B 4 first thefirst h-column is extracted and converted 
iotrfe bottom. wTh respect to H2 which is synthesized with B 4 later, thefirst w-row is extracted and converted to the 

SIT On the basis of the equation (8). the DCT coefficient of B 42 can be calculated directly from the DCT coefficient 
of B 4 in accordance with the following equation (9). 

DCT(B 42 ) = DCT(H ,) * DCT(B 4 ) x DCT(H 2 ) ( 9 ) 

f03071 This eouation is applied to all the subblocks and the total is calculated. Thus, the DCT coefficient of the new 
WockB" cln be obtained directly from the DCT coefficients of the origina. blocks B, to B 4 . as expressed by the followmg 
equation (10). 
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DCT[B DCTXH u )*DCT\B t )*DCI{H t2 ) 

...(10) 



[0308] The DCT coefficients of H n and H i2 may be calculated and stored in a memory in advance so as to constitute 
a table memory. In this manner, motion estimation and motion compensation can be carried out even in the orthogonal 
transform domain. 

[0309] Then, in the coding section 221 , when the motion vector is estimated by the ME section 272, the motion vector 
appended to the macroblock of the original compressed video signal is estimated by searching a narrow range on the 
basis of the activity calculated by the activity calculating section 200 from the conversion output of the resolution con- 
verting section 260, instead of estimating the motion vector in the absence of any information. 

[031 0] As described above, in the decoding section 21 1 of the digital video signal conversion device of this embodi- 
ment, predictive decoding processing along with motion compensation is carried out on the MPEG coded data on which 
hybrid coding including predictive coding along with motion detection and orthogonal transform coding is performed, 
that is, inverse quantization is carried out after variable-length decoding. Then, motion compensation is carried out to 
obtaindecoded data which remains in the DCT domain, and resolution conversion is performed on the decoded data 
of the DCT domain. Therefore, resolution conversion can be directly carried out in the orthogonally transformed domain 
and decoding (inverse orthogonal transform) to the time domain or spatial domain is not necessary. Thus, the calcula- 
tion is simplified and conversion of high quality with less computational errors can be carried out Moreover, in the cod- 
ing section 221, when the motion vector is estimated by the ME section 272, the motion vector appended to the 
macroblock of the original compressed video signal is estimated by searching a narrow range on the basis of the activity 
calculated from the resolution conversion output, instead of estimating the motion vector in the absence of any informa- 
tion. Therefore, as the calculation quantity of the ME section 272 can be significantly reduced, miniaturization of the 
device and reduction in the conversion processing time can be realized. 

[0311] A thirteenth embodiment will now be described. In this embodiment, too, a digital video signal conversion 
device for performing signal conversion processing such as resolution conversion processing on MPEG coded data and 
outputting video coded data is employed. 

[0312] This digital video signal conversion device has a decoding section 340 for obtaining data of the orthogonal 
transform domain by carrying out partial decoding processing on MPEG coded data on which the above-described 
hybrid coding is performed, a converting section 343 for performing resolution conversion processing on the data of the 
orthogonal transform domain from the decoding section 340, and a coding section 350 for adding a motion vector based 
on motion vector information of the MPEG coded data and performing compression coding processing on the conver- 
sion output from the converting section 343, as shown in Fig.27. 

[031 3] The decoding section 340 includes a VLD section 341 and an IQ section 342. These VLD section 341 and IQ 
section 342 have the structures similar to those of the VLD section 1 12 and the IQ section 1 13 of Fig.21 , respectively, 
and operate similarly. The characteristic of this decoding section 340 is that motion compensation is not carried out. 
[0314] Specifically, with respect to a P-picture and a B-picture, resolution conversion is carried out by the converting 
section 343 with respect to the DCT coefficient as differential information, without carrying out motion compensation. 
The converted DCT coefficient obtained through resolution conversion is quantized by a Q section 345 which is control- 
led in rate by a rate control section 348. The DCT coefficient is variable-length coded by a VLC section 346 and then 
outputted at a constant rate from a buffer memory 347. 

[031 5] In this case, a motion vector converting section 344 of the coding section 350 rescales the motion vector mv 
extracted by the VLD section 341 in accordance with the resolution conversion rate and supplies the reseated motion 
vector to the VLC section 346. 

[031 6] The VLC section 346 adds the rescaled motion vector mv to the quantized DCT coefficient from the Q section 
345 and carries out variable-length coding processing. The VLC section 346 then supplies the coded data to the buffer 
memory 347. 

[0317] As described above, in the digital video signal conversion device shown in Fig.27. since motion compensation 
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is not carried out in the decoding section 340 and the coding section 350, the calculation can be simplified and the bur- 
den on the hardware can be reduced. 

[0318] In the above-described digital video signal conversion devices, rate conversion may be earned out In short 
the digital video signal conversion devices may be applied to conversion of the transfer rate from 4 Mbps to 2 Mbps. with 

the resolution unchanged. ,. . 

[0319] Although the structures of the devices are described in the above-described embodiments, the respective 
devices may be constituted by using the digital signal conversion method of the present invention as software. 
[0320] According to the present invention, decoding along with motion compensation is earned out on an input infor- 
mation signal which is compression-coded along with motion detection, and signal conversion processing is carried out 
on the decoded signal. On this converted signal, compression coding processing along with mot.on detection based on 
motion vector information of the input information signal is carried out When resolution conversion processing is 
applied as this signal conversion processing, compression coding processing along with motion compensation based 
on information obtained by scale-converting the motion vector information in accordance with the resolution conversion 
processing is carried out on the converted signal. Particularly, the motion vector information required at the time of com- 
pression coding is converted in scale in accordance with the resolution conversion rate, and a narrow range is 
searched. Therefore, the calculation quantity at the time of motion vector estimation can be significantly reduced, and 
miniaturization of the device and reduction in the conversion processing time can be realized. 

[0321 ] Also according to the present invention, partial decoding is carried out on an input information signal on which 
compression coding including predictive coding along with motion detection and orthogonal transform coding is per- 
formed and a decoded signal of the orthogonal transform domain is thus obtained. Then, signal conversion processing 
is carried out on the decoded signal of the orthogonal transform domain. On this converted signal, compression coding 
processing along with motion compensation prediction using motion detection based on motion vector information of 
the input information signal is carried out. When resolution conversion processing is applied as this signal conversion 
processing compression coding processing along with motion compensation based on information obtained by con- 
verting the motion vector information in accordance with the activity obtained from the resolution conversion processing 
is carried out on the converted signal. Therefore, the motion vector information required at the time of compression cod- 
ing can be estimated by searching a narrow range, and the calculation quantity can be significantly reduced. Thus, min- 
iaturization of the device and reduction in the conversion processing time can be realized. Also, since signal conversion 
processing can be carried out in the orthogonal transform domain, inverse orthogonal transform processing is not 
required and decoding (inverse orthogonal transform) to the time domain or spatial domain is not required. Therefore, 
the calculation is simplified and conversion of high quality with less computational errors can be carried out. 
[0322] Moreover, according to the present invention, partial decoding is carried out on an input information signal on 
which compression coding including predictive coding along with motion detection and orthogonal transform coding is 
performed and a decoded signal of the orthogonal transform domain is thus obtained. Then, signal conversion 
processing is carried out on the decoded signal of the orthogonal transform domain. On this converted signal, compres- 
sion coding processing is carried out by adding motion vector information converted on the basts of motion vector infor- 
mation of the input information signal. Therefore, when resolution conversion processing is applied as this signal 
conversion processing, compression coding processing by adding information obtained by scale-converting the motion 
vector information in accordance with the resolution conversion processing is carried out on the converted signal. 
[0323] That is, since the motion vector information added at the time of compression coding can be estimated by 
searching a narrow range, and the calculation quantity at the time of motion vector estimation can be significantly 
reduced. Also, since signal conversion processing can be carried out in the orthogonal transform domain, inverse 
orthogonal transform processing is not required. In addition, since motion compensation processing is not used at the 
time of decoding and coding, the calculation quantity can be reduced further. 



Claims 



1 . A digital signal conversion method comprising: 

a data extraction step of extracting a part of orthogonal transform coefficients from respective blocks of a digital 
signal of a first format consisting of orthogonal transform coefficient blocks of a predetermined unit, thus con- 
stituting partial blocks; 

an inverse orthogonal transform step of carrying out inverse orthogonal transform of the orthogonal transform 
coefficients constituting each partial block, on the partial block basis; 

a partial block connection step of connecting the partial blocks processed by inverse orthogonal transform, 
thus constituting a new block of the predetermined unit; and 
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an orthogonal transform step of orthogonally transforming the new block on the block basis thus generating a 
second digital signal consisting of the new orthogonal transform block of the predetermmed unit. 

The digital signal conversion method as claimed in claim 1. wherein the orthogonal transform is discrete cosine 
transform, the digital signal of the first format is a video signal compression-coded at a predetermined fnced rate 
using variable-length coding, and the digital signal of the second format is a video signal compress,on-coded at a 
variable rate. 

3. The digital signal conversion method as claimed in claim 1 . wherein at the data faction step, discrete cosine 
transform coefficients on the low-frequency side are extracted from the respective blocks of the digital signal of the 
first format, and the number of discrete cosine transform coefficients of a horizontal component of a luminance sig- 
nal the number of discrete cosine transform coefficients of a horizontal component of a color-drfference signal and 
the number of discrete cosine transform coefficients of a vertical component thereof are reduced. 

4. The digital signal conversion method as claimed in claim 1 , wherein in the case where one frame of the digital sig- 
nal of the first format is constituted by two frames, 

at the data extraction step, field separation for separating discrete cosine transform coefficients constituting 
line of an odd field of the frame and discrete cosine transform coefficients constituting lines of an even field of 
the frame, and generating a block consisting of the discrete cosine transform coefficients of one of these fields 
is carried out. 

5 The digital signal conversion method as claimed in claim 1 , wherein the digital signal of the first format is a com- 
pressed video signal having a resolution of 720x480 pixels and a ratio of the sampling frequency of a luminance 
signal to the sampling frequencies of color-difference signals equal to 4:1 :1 . and the digital signal of the second for- 
mat is a compressed video signal having a resolution of 360x240 pixels and a ratio of the sampling frequency of a 
luminance signal to the sampling frequencies of color<iifference signals equal to 4:2:0. 

6 The digital signal conversion method as claimed in claim 1 . wherein the digital signal of the first format is a com- 
pressed video signal having a resolution of 720x480 pixels and a ratio of the sampling frequency of a luminance 
signal to the sampling frequencies of color-difference signals equal to 4:2:0. and the digital signal of the second for- 
mat is a compressed video signal having a resolution of 360x240 pixels and a ratio of the sampling frequency of a 
luminance signal to the sampling frequencies of color<Jifference signals equal to 4:2:0. 

The digital signal conversion method as claimed in claim 1. wherein at the data extraction step, orthogonal trans- 
form coefficients on the low-frequency side are extracted from the respective blocks of the digital signal of the first 
format, and the number of discrete cosine transform coefficients of a vertical component of a color^Jifference signal 
is reduced to 1/2. 

The digital signal conversion method as claimed in claim 7. wherein the digital signal of the first format is a com- 
pressed video signal having a resolution of 720x480 pixels and a ratio of the sampling frequency of a luminance 
signal to the sampling frequencies of color-difference signals equal to 4:1 :1 , and the digital signal of the second for- 
mat is a compressed video signal having a resolution of 720x480 pixels and a ratio of the sampling frequency of a 
luminance signal to the sampling frequencies of color-drfference signals equal to 4:2:0. 



45 



50 



9. A digital signal conversion method comprising: 

an inverse orthogonal transform step of carrying out inverse orthogonal transform of a digital signal of a first 
format consisting of orthogonal transform coefficient blocks of a predetermined unit, on the block basis; 

a block division step of dividing each block of the digital signal of the first format processed by inverse orthog- 
onal transform; 

an orthogonal transform step of orthogonally transforming orthogonal transform coefficients constituting each 
divided block, on the divided block basis; and 

a data enlargement step of interpolating the value of each orthogonally transformed block with an orthogonal 
transform coefficient to constitute the predetermined unit, thus generating a digital signal of a second format. 
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The digital signal conversion method as claimed in Cairn 9. wherein the orthogonal f^^~Jj£"™ 
transform the digital signal of the first format is a video signal compress.on«x>ded at a predetermined I fixed rate 
uTnfvS'aStlength ceding, and the digital signa. of the second format is a video s.gna. compression-coded at a 



variable rate. 

1 1 The digital signal conversion method as claimed in claim 9. wherein at the data enlargement step, discrete .cosine 
.^sformco^ 

frSu^de. and the high-frequency side thereof is interpolated with 0. thus constituting the respects blocks 
of the predetermined unit. 

12 The digital signal conversion method as claimed in claim 9. wherein the digital signal of the first format is a com- 
pTesS v deo signa. having a resolution of 720x480 pixels and a ratio of the sa mphng a J"™£" 
s gnal to the sampling frequencies of color-difference signals equal to 4:1 :1 , and the digrtal signa of the second for- 
mat 1 a compreTsed vid^ signal having a resolution of 720x480 pixels and a rato of the sampl.ng frequency of a 
luminance signal to the sampling frequencies of color-difference signals equal to 4:2:0. 

13 The digital signal conversion method as claimed in claim 9. wherein the digital signal of the first ^tea^ 
pressed video signal having a resolution of 720x480 pixels and a ratio of the sampl.ng frequency of a luminance 
s gnalTo Ihe sampling frequencies of color-difference signals equal to 42:0. and the digital signa of the second for- 
ma? is e .composed LSo signa. having a resolution of 720x480 pixels and a ratio of the sampling frequency of a 
luminance signal to the sampling frequencies of color-difference signals equal to 4:2:0. 

14. A digital signal conversion device comprising: 

decoding means for decoding a digital signal of a first format consisting of orthogonal transform coefficients of 
a predetermined unit; 

inverse quantization means for inversely quantizing the decoded digital signal; 

resolution conversion means for extracting a part of the orthogonal transform coefficients adjacent blocks 
of orthogonal transform coefficient blocks of the predetermined unit of the inversely quantized digital s.gnal. 
thus constituting partial blocks, and converting the resolution; 

quantization means for quantizing the digital signal processed by resolution conversion; and 

coding means for coding the quantized digital signal, thus generating a digital signal of a second format. 

1 5 The digital signal conversion device as claimed in claim 14. wherein the resolution conversion means connects the 
' inversely orthogonally transformed partial blocks, thus constituting a new block of the predetermined unit. 

The digital signal conversion device as claimed in claim 14, wherein the orthogonal transform is discrete cosine 
transform the digital signal of the first format is a video signal compression-coded at a predetermined fixed rate 
using variable-length coding, and the digital signal of the second format is a video signal compress.on-coded at a 
variable rate. 

17 The digital signal conversion device as claimed in claim 16. wherein the resolution conversion means extracts 
" orthogonal transform coefficients on the low-frequency side from the respective blocks of the digital s.gnal of the 
first format, and reduces the number of discrete cosine transform coefficients to 1/2. 



16. 



18. A digital signal conversion device comprising: 

decoding means for decoding a digital signal of a first format consisting of orthogonal transform coefficient 
blocks of a predetermined unit; 

inverse quantization means for inversely quantizing the decoded digital signal; 

resolution conversion means for interpolating the respective blocks of the predetermined unit of the inversely 
quantized digital signal with an orthogonal transform coefficient of a predetermined value, thus constituting the 
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predetermined unit, and converting the resolution; 

quantization means for quantizing the digital signal processed by resolution conversion; and 
5 coding means for coding the quantized digital signal, thus generating a digital signal of a second format 

19. The digital signal conversion device as claimed in claim 18, wherein the resolution conversion means interpolates 
with 0 the high-frequency side of the orthogonal transform coefficients of the divided respective blocks of the digital 
signal of the first format, thus constituting the respective block of the predetermined unit. 

10 

20. A digital signal conversion method for converting a digital signal of a first format consisting of orthogonal transform 
coefficient blocks of a predetermined unit to a digital signal of a second format consisting of new orthogonal trans- 
form coefficient blocks of another predetermined unit, the method comprising the step of 

is controlling the data quantity of the digital signal of the second format by utilizing data quantity information 

included in the digital signal of the first format. 

21 . The digital signal conversion method as claimed in claim 20, wherein the orthogonal transform is discrete cosine 
transform, the digital signal of the first format is a video signal compression-coded at a predetermined fixed rate, 

20 and the digital signal of the second format is a video signal compression-coded at a variable rate. 

22. The digital signal conversion method as claimed in claim 20, wherein the data quantity of the digital signal of the 
second format is controlled in the orthogonal transform domain. 

25 23. The digital signal conversion method as claimed in claim 20, wherein the data quantity of the digital signal of the 
second format is controlled in the spatial domain. 

24. The digital signal conversion method as claimed in claim 20, further comprising; 

30 a quantization parameter calculation step of calculating quantization parameters on the basis of the quantizer 

number and class information for the respective predetermined blocks of the digital signal of the first format; 

a meta-block quantization parameter calculation step of averaging the quantization parameters calculated for 
the respective blocks and calculating a quantization parameter for a meta-block consisting of a plurality of block 
35 units; and 

a quantizer scale calculation step of calculating the quantizer scale of the digital signal of the second format 
from the quantization parameter for each meta-block; 

40 the respective blocks being quantized by using the calculated quantizer scale. 

25. The digital signal conversion method as claimed in claim 20, further comprising: 

a total of generated bits calculation step of calculating the total number of generated bits for each frame of the 
45 digital signal of the first format; and 

a quantization parameter adjustment step of adjusting the quantization parameter using a value obtained by 
multiplying the difference between the total number of generated bits and a target number of bits by a constant; 
wherein a new quantizer scale is calculated by using the adjusted quantization parameter, thus using the new 
so quantizer scale for a next frame of the digital signal of the second format. 

26. A digital signal conversion device for converting a digital signal of a first format consisting of orthogonal transform 
coefficient blocks of a predetermined unit to a digital signal of a second format consisting of new orthogonal trans- 
form coefficient blocks of another predetermined unit, the device comprising: 

55 

decoding means for decoding the digital signal of the first format; 

inverse quantization means for inversely quantizing the decoded digital signal; 
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signal conversion means for carrying out signal processing accompanying format conversion of the inversely 
quantized digital signal; 

quantization means for quantizing the digital signal processed by signal processing: 

data quantity control means for controlling the data quantity in the quantization means; and 

coding means for coding the digital signal which is quantized and has its data quantity controlled by the data 
quantity control means, thus generating the digital signal of the second format. 

27 The dioitial signal conversion device as claimed in claim 26. wherein the orthogonal transform is discrete cosine 
ZSrT £ Sta. signal of the first format is a video s,gna I ^T^^J^^^ M 
and the digital signal of the second format is a video s,gnal compression-coded at a variable rate. 

28 The dioital signal conversion device as claimed in claim 26. wherein the signal conversion means controlsthe data 
i£arS of of the second format in the orthogonal transform domain by utjfizing data quantty ,nfor- 
mation included in the digital signal of the first format 

29 The dioital signal conversion device as claimed in claim 26. wherein the signal conversion means controls the date 
SartlfyrtSdigSl signal of the second format in me spatial don^n by utilizing date quarrtrty.nfomal.onmd 

in the digital signal of the first format. 

30 The digital signal conversion device as claimed in claim 26. wherein the signal conversion means ^ 1 ^ t ^" a "- 
t zatio Parameters on the basis of the quantizer number and class information for the respective blocks induded 
^JSZS£2*» *- ave ^es the quantization parameters T^SJSS? 
as to emulate the quantization parameter of a meta-block consisting of a p.urahty of blocks, calculates the quan- 
""scale of the digital signal of the second format from the quantization parameter of each meta-block, and quan- 
tizes the respective blocks by using the calculated quantizer scale. 

31 . A digital signal conversion method for converting a digital signal of a first format to a digital signal of a second for- 
mat, the method comprising: 

a decoding step of decoding the digital signal of the first format; 

a signal conversion step of converting the decoded digital signal of the first format to the digital signal of the 
second format; 

a coding step of coding the digital signal of the second format; and 

a weighting processing step of collectively carrying out inverse weighting for the digital signal of the first format 
and weighting for the digital signal of the second format. 

32 The digital signal conversion method as claimed in claim 31. wherein the digital signal of the first format is an 
' orthogonally transformed digital signal, and the weighting processing step is carried out tn the orthogonal transform 

domain. 

33 The digital signal conversion method as claimed in claim 31. wherein the digital signal of the first format is an 
' orthogonally transformed digital signal, and the weighting processing step is carried out in the spatial domain after 

the orthogonally transformed digital signal is inversely orthogonally transformed. 

34 The digital signal conversion method as claimed in daim 31 , wherein the digital signal of the first format is a video 
' signal compression-coded at a predetermined fixed rate by discrete cosine transform, and the digrtal signal of the 

second format is a video signal compression-ceded at a variable rate by discrete cosine transform. 

35 The digital signal conversion method as claimed in claim 31, wherein the weighting processing step is carried out 
' after inverse quantization of the digital signal of the first format and before the signal conversion step. 

36. The digital signal conversion method as claimed in claim 31, wherein the weighting processing step is carried out 
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after the signal conversion step and before quantization of the digital signal of the second format. 

37. A digital signal conversion device for converting a digital signal of a first format to a digital signal of a second format, 
the device comprising: 

decoding means for decoding the digital signal of the first format; 

signal conversion means for converting the decoded digital signal of the first format to the digital signal of the 
second format; 

coding means for coding the digital signal of the second format; and 

weighting processing means for collectively carrying out inverse weighting for the digital signal of the first for- 
mat and weighting for the digital signal of the second format. 

38 The digital signal conversion device as claimed in claim 37, wherein the digital signal of the first format is an orthog- 
onally transformed digital signal, and the weighting processing means carries out inverse weighting for the digital 
signal of the first format and weighting for the digital signal of the second format in the orthogonal transform 
domain. 

39 The digital signal conversion device as claimed in claim 37, wherein the digital signal of the first format is an orthog- 
" onally transformed digital signal, and the weighting processing means carries out inverse weighting for the digital 

signal of the f irst format and weighting of the digital signal of the second format in the spatial domain. 

40 The digital signal conversion device as claimed in claim 37, wherein the digital signal of the first format is a video 
signal compression-coded at a predetermined fixed rate by discrete cosine transform, and the digital signal of the 
second format is a video signal compression-coded at a variable rate by discrete cosine transform. 

41 The digital signal conversion device as claimed in claim 37, wherein the weighting processing means carries out 
inverse weighting for the digital signal of the first format and weighting for the digital signal of the second format 
after inverse quantization of the digital signal of the first format. 

42 The digital signal conversion device as claimed in claim 37, wherein the weighting processing means carries out 
inverse weighting for the digital signal of the first format and weighting for the digital signal of the second format 
before quantization of the digital signal of the second format. 

43. A digital signal conversion method comprising: 

a decoding step of carrying out decoding along with motion compensation on an input information signal com- 
pression-coded along with motion detection; 

a signal conversion processing step of carrying out signal conversion processing on the decoded signal from 
the decoding step; and 

a coding processing step of carrying out compression coding processing on the converted signal from the sig- 
nal conversion processing step along with motion detection based on motion vector information of the input 
information signal. 

44. The digital signal conversion method as claimed in claim 43, wherein at the signal conversion processing step, res- 
olution conversion processing is carried out on the decoded signal. 

45. The digital signal conversion method as claimed in claim 44, wherein at the coding processing step, compression 
coding processing based on information obtained by scale-converting the motion vector information in accordance 
with the resolution conversion processing is carried out on the converted signal. 

46. The digital signal conversion method as claimed in claim 43, wherein at the signal conversion processing step, rate 
conversion processing is carried out on the decoded signal. 
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47. A digital signal conversion device comprising: 

decoding means for carrying out decoding along with motion compensation on an input information signal com- 
pression-coded along with motion detection; 
5 signal conversion processing means for carrying out signal conversion processing on the decoded signal from 

the decoding means; and 

coding processing means for carrying out compression coding processing on the converted signal from the sig- 
nal conversion processing means along with motion detection based on motion vector information of the input 
information signal. 

10 

48. A digital signal conversion method comprising: 

a decoding step of carrying out only predictive decoding processing along with motion compensation on an 
input information signal on which compression coding including predictive coding along with motion detection 
15 and orthogonal transform coding is performed, thereby obtaining a decoded signal in the orthogonal transform 

domain on which orthogonal transform coding is performed; 

a signal conversion processing step of carrying out signal conversion processing on the decoded signal of the 
orthogonal transform domain from the decoding step; and 

20 

a coding processing step of carrying out compression coding processing along with motion compensation pre- 
diction on the converted signal from the signal conversion processing step by using motion detection based on 
motion vector information of the input information signal. 

25 49. The digital signal conversion method as claimed in claim 48, wherein at the signal conversion processing step, sig- 
nal conversion processing is carried out on the decoded signal of the orthogonal transform domain from the decod- 
ing step by using a transform matrix generated on the basis of an inverse orthogonal transform matrix 
corresponding to an orthogonal transform matrix used for orthogonal transform coding performed on the input infor- 
mation signal and an orthogonal transform matrix corresponding to an inverse orthogonal transform matrix used for 

30 obtaining a signal conversion output signal in the time domain. 

50. The digital signal conversion method as claimed in claim 48, wherein at the signal conversion processing step, res- 
olution conversion processing is carried out on the decoded signal of the orthogonal transform domain from the 
decoding step. 

35 

51 . The digital signal conversion method as claimed in claim 50, wherein at the coding processing step, compression 
coding processing based on information obtained by scale-converting the motion vector information in accordance 
with the resolution conversion processing is carried out on the converted signal. 

40 52. The digital signal conversion method as claimed in claim 48, wherein at the signal conversion processing step, rate 
conversion processing is carried out on the decoded signal of the orthogonal transform domain from the decoding 
step. 

53. A digital signal conversion device comprising: 

45 

decoding means for carrying out only predictive decoding processing along with motion compensation on an 
input information signal on which compression coding including predictive coding along with motion detection 
and orthogonal transform coding is performed, thereby obtaining a decoded signal in the orthogonal transform 
domain on which orthogonal transform coding is performed; 

50 

signal conversion means for carrying out signal conversion processing on the decoded signal of the orthogonal 
transform domain from the decoding means; and 

coding processing means for carrying out compression coding processing along with motion compensation 
55 prediction on the converted signal from the signal conversion processing means by using motion detection 

based on motion vector information of the input information signal. 

54. A digital signal conversion method comprising: 
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a decoding step of carrying out partial decoding processing on an input information signal processed by com- 
pression coding including predictive coding along with motion detection and orthogonal transform coding, thus 
obtaining a signal of the orthogonal transform domain; 

a signal conversion processing step of carrying out signal conversion processing on the signal of the orthogo- 
nal transform domain from the decoding step; and 

a coding processing step of adding motion vector information converted on the basis of motion vector informa- 
tion of the input information signal and carrying out compression coding processing on the converted signal 
from the signal conversion processing step. 

55 The digital signal conversion method as claimed in claim 54, wherein at the signal conversion processing step, sig- 
' nal conversion processing is carried out on the decoded signal of the orthogonal transform domain from the decod- 
ing step by using a transform matrix generated on the basis of an inverse orthogonal transform - matrix 
corresponding to an orthogonal transform matrix used for orthogonal transform coding performed on the input infor- 
mation signal and an orthogonal transform matrix corresponding to an inverse orthogonal transform matrix used for 
obtaining a signal conversion output signal in the time domain. 

56 The digital signal conversion method as claimed in claim 54, wherein at the signal conversion processing step, res- 
' olution conversion processing is carried out on the decoded signal of the orthogonal transform domain from the 

decoding step. 

57 The digital signal conversion method as claimed in claim 56, wherein at the coding processing step, compression 
" coding processing by adding information obtained by scale-converting the motion vector information in accordance 

with the resolution conversion processing is carried out on the converted signal. 

58 The digital signal conversion method as claimed in claim 54, wherein at the signal conversion processing step, rate 
* conversion processing is carried out on the decoded signal of the orthogonal transform domain from the decoding 

step. 

59. A digital signal conversion device comprising: 

decoding means for carrying out partial decoding processing on an input information signal processed by com- 
pression coding including predictive coding along with motion detection and orthogonal transform coding, thus 
obtaining a signal of the orthogonal transform domain; 

signal conversion processing means for carrying out signal conversion processing on the signal of the orthog- 
onal transform domain from the decoding means; and 

coding processing means for adding motion vector information converted on the basis of motion vector infor- 
mation of the input information signal and carrying out compression coding processing on the converted signal 
from the signal conversion processing means. 

60 A digital signal conversion method for converting a digital signal of a first format having dynamic mode/static mode 
information added thereto in advance to a digital signal of a second format accompanying coding using inter-frame 
difference, the method comprising: 

a decoding step of decoding the digital signal of the f irst format; 

a signal conversion step of carrying out signal conversion processing on the decoded signal from the decoding 

adiscrimination step of discriminating whether or not to carry out inter-frame differential coding for each pre- 
determined block of the converted signal from the signal conversion step in accordance with the dynamic 
mode/static mode information; and 

a coding step of coding the converted signal on the basis of the result of discrimination from the discrimination 
step and outputting the digital signal of the second format. 

61 The digital signal conversion method as claimed in claim 60. wherein at the decoding step, the digital signal of the 
first format is partially decoded to output a signal of the orthogonal transform domain, and at the signal conversion 
step signal conversion processing is carried out on the signal of the orthogonal transform domain. 
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62. The digital signal conversion method as claimed in claim 61, wherein the orthogonal transform is discrete cosine 
transform. 

63. The digital signal conversion method as claimed in claim 60, wherein at the signal conversion step, signal conver- 
5 sion processing is carried out on the digital signal of the first format by using a transform matrix generated on the 

basis of an inverse orthogonal transform matrix corresponding to an orthogonal transform matrix used for orthog- 
onal transform coding performed on the digital signal of the first format and an orthogonal transform matrix corre- 
sponding to an inverse orthogonal transform matrix used for obtaining the digital signal of the second format. 

w 64. The digital signal conversion method as claimed in claim 60, wherein at the discrimination step, whether or not to 
carry out the inter-frame differential coding for each macroblock of the converted signal from the signal conversion 
step is discriminated. 

65. A digital signal conversion device for converting a digital signal of a first format having dynamic mode/static mode 
is information added thereto in advance to a digital signal of a second format accompanying coding using inter-frame 
difference, the device comprising: 

decoding means for decoding the digital signal of the first format; 

20 signal conversion means for carrying out signal conversion processing on the decoded signal from the decod- 

ing means; 

discrimination means for discriminating whether or not to carry out inter-frame differential coding for each pre- 
determined block of the converted signal from the signal conversion means in accordance with the dynamic 
25 mode/static mode information; and 

coding means for coding the converted signal on the basis of the result of discrimination from the discrimination 
means and outputting the digital signal of the second format. 

30 66. A digital signal conversion method for converting a digital signal of a first format to a digital signal of a second for- 
mat accompanying coding using inter-frame difference, the method comprising: 

a decoding step of carrying out partial decoding on the digital signal of the first format, thus obtaining a signal 
of the orthogonal transform domain; 
35 a signal conversion step of carrying out signal conversion processing on the signal of the orthogonal transform 

domain from the decoding step; 

a discrimination step of discriminating whether or not to carry out inter-frame differential coding for each pre- 
determined block of the converted signal from the signal conversion step in accordance with a maximum value 
of an absolute value of the inter-frame difference of the converted signal; and 
40 a coding step of coding the converted signal from the signal conversion step on the basis of the result of dis- 

crimination from the discrimination step and outputting the digital signal of the second format. 

67. The digital signal conversion method as claimed in claim 66. wherein the orthogonal transform is discrete cosine 
transform. 

45 

68. The digital signal conversion method as claimed in claim 66, wherein at the signal conversion step, signal conver- 
sion processing is carried out on the digital signal of the first format by using a transform matrix generated on the 
basis of an inverse orthogonal transform matrix corresponding to an orthogonal transform matrix used for orthog- 
onal transform coding performed on the digital signal of the first format and an orthogonal transform matrix corre- 

50 sponding to an inverse orthogonal transform matrix used for obtaining the digital signal of the second format. 

69. The digital signal conversion method as claimed in claim 66. wherein at the discrimination step, whether or not to 
carry out the inter-frame differential coding for each macroblock of the converted signal from the signal conversion 
step is discriminated. 

70. A digital signal conversion device for converting a digital signal of a first format to a digital signal of a second format 
accompanying coding using inter-frame difference, the device comprising: 
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decoding means for carrying out partial decoding on the digital signal of the first format, thus obtaining a signal 
of the orthogonal transform domain; ... 
signal conversion means for carrying out signal conversion processing on the signal of the orthogonal trans- 
fnrm domain from the decoding means; ,. , 

SsTriminTt ion means for discriminating whether or not to carry out inter-frame differential cod.ng for each pre- 
determined block of the converted signal from the signal conversion means in accordance wrth a maximum 
value of an absolute value of the inter-frame difference of the converted signal; and 

coding means for coding the converted signal from the signal convers.on means on the basis of the result of 
discrimination from the discrimination means and outputting the digital signal of the second format 

71. A digital signal conversion method comprising: 

an inverse orthogonal transform step ot carrying out inverse orthogonal transform on an infra-frame coded sig- 
nal and a forward predictive coded signal, of a digital signal of a f irst format including an '"tra-frame coded hag- 
nal processed by infra-frame coding and a forward predictive coded signal and a bidirectional* predKtive 
coded signal processed by forward and bidirectional inter-trame predictive coding along «r* m*c ^«*°"; 
a motion compensation output generation step of generating a motion compensation ^^to added to he 
partially decoded forward predictive coded signal and bidirectionally predictive coded s.gnal on the basis of the 
conversion output from the inverse orthogonal transform step; -^s™, 
an orthogonal transform step of orthogonally transforming the motion compensation output from the motion 
comoensation output generation step; 

an addition step of adding the orthogonal transform oufput from the orthogonal transform step to the partially 
decoded forward predictive coded signal and bidirectionally predictive coded signal; and 
a coding step of carrying out compression coding on a signal based on the addition output and outputting a 
digital signal of a second format. 

72 The digital signal conversion method as claimed in claim 71, further comprising a conversion step of currying out 
signal conversion processing on the addition output between the addition step and the cod,ng at epwhe mtftta 
coding step, the compression coding processing is earned out on the converted signal from the convers.on step. 

73. The digital signal conversion method as claimed in claim 71 . wherein the orthogonal transform is discrete cosine 
transform. 

74 The digital signal conversion method as claimed in claim 72. wherein at the conversion step, signal conversion is 
' carried out on the output from the addition step by using a transform matrix generated on the basis ofan inverse 
orthogonal transform matrix corresponding to an orthogonal transform matrix used for orthogonal transform coding 
performed on the digital signal of the first format and an orthogonal transform matrix corresponding to an inverse 
orthogonal transform matrix used for obtaining the digital signal of the second format. 

75. A digital signal conversion device comprising: 

inverse orthogonal transform means for carrying out inverse orthogonal transform on an intra-frame coded sig- 
nal and a forward predictive coded signal, of a digital signal of a first format including an intra-frame coded sig- 
nal processed by intra-frame coding and a forward predictive coded signal and a bidirectionally Predictive 
coded signal processed by forward and bidirectional irrter-frame predictive coding along wrth motion detection; 
motion compensation output generation means for generating a motion compensation output to be added to 
the partially decoded forward predictive coded signal and bidirectionally predictive coded signal on the basis 
of the conversion output from the inverse orthogonal transform means; 

orthogonal transform means for orthogonally transforming the motion compensation output from the motion 
compensation output generation means; 

addition means for adding the orthogonal transform output from the orthogonal transform means to the par- 
tially decoded forward predictive coded signal and bidirectionally predictive coded signal; and 
coding means for carrying out compression coding on a signal based on the addition output and outputting a 
digital signal of a second format. 

76 The digital signal conversion device as claimed in claim 75. further comprising conversion means for carrying out 
' signal conversion processing on the addition output between the addition means and the coding means, wherein 
the coding means carries out the compression coding processing on the converted signal from the convers.on 
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